ColossalAI/colossalai
1SAA 219df6e685 Optimized MoE layer and fixed some bugs;
Decreased moe tests;

Added FFNExperts and ViTMoE model
2022-03-11 15:50:28 +08:00
..
amp fixed apex import (#227) 2022-02-15 11:31:13 +08:00
builder add pytorch hooks (#179) 2022-01-25 22:20:54 +08:00
communication moved env variables to global variables; (#215) 2022-02-15 11:31:13 +08:00
context moved env variables to global variables; (#215) 2022-02-15 11:31:13 +08:00
engine moved env variables to global variables; (#215) 2022-02-15 11:31:13 +08:00
kernel Optimized MoE layer and fixed some bugs; 2022-03-11 15:50:28 +08:00
logging fixed mkdir conflict and align yapf config with flake (#220) 2022-02-15 11:31:13 +08:00
nn Optimized MoE layer and fixed some bugs; 2022-03-11 15:50:28 +08:00
registry add pytorch hooks (#179) 2022-01-25 22:20:54 +08:00
trainer moved env variables to global variables; (#215) 2022-02-15 11:31:13 +08:00
utils fixed mkdir conflict and align yapf config with flake (#220) 2022-02-15 11:31:13 +08:00
zero Fixed docstring in colossalai (#171) 2022-01-21 10:44:30 +08:00
__init__.py Develop/experiments (#59) 2021-12-09 15:08:29 +08:00
constants.py moved env variables to global variables; (#215) 2022-02-15 11:31:13 +08:00
core.py Develop/experiments (#59) 2021-12-09 15:08:29 +08:00
global_variables.py Optimized MoE layer and fixed some bugs; 2022-03-11 15:50:28 +08:00
initialize.py fixed ddp bug on torch 1.8 (#194) 2022-01-28 15:14:04 +08:00