Xuanlei Zhao f71e63b0f3 [moe] support optimizer checkpoint (#5015) ... * Refactor MoE Manager setup method * unshard optim ckpt * optim io * update transformer version * update requirements * update ckpt * update ckpt * update ckpt * fix engine * fix engine		2023-11-08 15:07:03 +00:00
..
__init__.py	[moe] support optimizer checkpoint (#5015)	2023-11-08 15:07:03 +00:00
_operation.py	[moe] merge moe into main (#4978)	2023-11-02 02:21:24 +00:00
checkpoint.py	[moe] support optimizer checkpoint (#5015)	2023-11-08 15:07:03 +00:00
experts.py	[moe] support optimizer checkpoint (#5015)	2023-11-08 15:07:03 +00:00
layers.py	[moe] merge moe into main (#4978)	2023-11-02 02:21:24 +00:00
load_balance.py	[moe] merge moe into main (#4978)	2023-11-02 02:21:24 +00:00
loss.py	[moe] merge moe into main (#4978)	2023-11-02 02:21:24 +00:00
manager.py	[moe] support optimizer checkpoint (#5015)	2023-11-08 15:07:03 +00:00
routers.py	[moe] merge moe into main (#4978)	2023-11-02 02:21:24 +00:00
utils.py	[moe] merge moe into main (#4978)	2023-11-02 02:21:24 +00:00