ColossalAI/colossalai/kernel/cuda_native
1SAA 219df6e685 Optimized MoE layer and fixed some bugs;
Decreased moe tests;

Added FFNExperts and ViTMoE model
2022-03-11 15:50:28 +08:00
..
csrc Optimized MoE layer and fixed some bugs; 2022-03-11 15:50:28 +08:00
__init__.py refactor kernel (#142) 2022-01-13 16:47:17 +08:00
layer_norm.py moved env variables to global variables; (#215) 2022-02-15 11:31:13 +08:00
multihead_attention.py Fixed docstring in colossalai (#171) 2022-01-21 10:44:30 +08:00
scaled_softmax.py Fixed docstring in colossalai (#171) 2022-01-21 10:44:30 +08:00