Commit Graph

5 Commits (53bb3bcc0af8b5b7ef0fe0d13bda7d853e4ec78c)

Author SHA1 Message Date
1SAA 82023779bb Added TPExpert for special situation
3 years ago
HELSON 36b8477228 Fixed parameter initialization in FFNExpert (#251)
3 years ago
1SAA 219df6e685 Optimized MoE layer and fixed some bugs;
3 years ago
HELSON 0f8c7f9804
Fixed docstring in colossalai (#171)
3 years ago
HELSON dceae85195
Added MoE parallel (#127)
3 years ago