Commit Graph

4 Commits (f9afe0addd89303de4819debd93efe97d5618238)

Author SHA1 Message Date
digger yu 5e1c93d732
[hotfix] fix typo change MoECheckpintIO to MoECheckpointIO (#5335)
9 months ago
Xuanlei Zhao 7d8e0338a4 [moe] init mixtral impl
10 months ago
Xuanlei Zhao f71e63b0f3
[moe] support optimizer checkpoint (#5015)
1 year ago
Xuanlei Zhao dc003c304c
[moe] merge moe into main (#4978)
1 year ago