Commit Graph

4 Commits (ca674549e0ea815f949d19654b110d7f065e3496)

Author SHA1 Message Date
digger yu 5e1c93d732
[hotfix] fix typo change MoECheckpintIO to MoECheckpointIO (#5335)
9 months ago
Xuanlei Zhao 7d8e0338a4 [moe] init mixtral impl
10 months ago
Xuanlei Zhao f71e63b0f3
[moe] support optimizer checkpoint (#5015)
1 year ago
Xuanlei Zhao dc003c304c
[moe] merge moe into main (#4978)
1 year ago