Commit Graph

4 Commits (34e909256c3fb43e5cec2c4c53437166557eb39a)

Author SHA1 Message Date
digger yu 5e1c93d732
[hotfix] fix typo change MoECheckpintIO to MoECheckpointIO (#5335)
9 months ago
Xuanlei Zhao 7d8e0338a4 [moe] init mixtral impl
10 months ago
Xuanlei Zhao f71e63b0f3
[moe] support optimizer checkpoint (#5015)
1 year ago
Xuanlei Zhao dc003c304c
[moe] merge moe into main (#4978)
1 year ago