ColossalAI/colossalai/nn/layer
1SAA 219df6e685 Optimized MoE layer and fixed some bugs;
Decreased moe tests;

Added FFNExperts and ViTMoE model
2022-03-11 15:50:28 +08:00
..
colossalai_layer moved env variables to global variables; (#215) 2022-02-15 11:31:13 +08:00
moe Optimized MoE layer and fixed some bugs; 2022-03-11 15:50:28 +08:00
parallel_1d fixed padding index issue for vocab parallel embedding layers; updated 3D linear to be compatible with examples in the tutorial 2022-03-11 15:50:28 +08:00
parallel_2d fixed padding index issue for vocab parallel embedding layers; updated 3D linear to be compatible with examples in the tutorial 2022-03-11 15:50:28 +08:00
parallel_2p5d fixed padding index issue for vocab parallel embedding layers; updated 3D linear to be compatible with examples in the tutorial 2022-03-11 15:50:28 +08:00
parallel_3d fixed padding index issue for vocab parallel embedding layers; updated 3D linear to be compatible with examples in the tutorial 2022-03-11 15:50:28 +08:00
parallel_sequence adapted for sequence parallel (#163) 2022-01-20 13:44:51 +08:00
utils moved env variables to global variables; (#215) 2022-02-15 11:31:13 +08:00
vanilla moved env variables to global variables; (#215) 2022-02-15 11:31:13 +08:00
wrapper Fixed docstring in colossalai (#171) 2022-01-21 10:44:30 +08:00
__init__.py Hotfix/Colossalai layers (#92) 2021-12-29 23:32:10 +08:00
base_layer.py Migrated project 2021-10-28 18:21:23 +02:00