Xuanlei Zhao f71e63b0f3 [moe] support optimizer checkpoint (#5015) ... * Refactor MoE Manager setup method * unshard optim ckpt * optim io * update transformer version * update requirements * update ckpt * update ckpt * update ckpt * fix engine * fix engine		2023-11-08 15:07:03 +00:00
..
benchmark_cai.py	[moe] support optimizer checkpoint (#5015)	2023-11-08 15:07:03 +00:00
benchmark_cai.sh	[moe] merge moe into main (#4978)	2023-11-02 02:21:24 +00:00
benchmark_cai_dist.sh	[moe] merge moe into main (#4978)	2023-11-02 02:21:24 +00:00
benchmark_fsdp.py	[moe] support optimizer checkpoint (#5015)	2023-11-08 15:07:03 +00:00
benchmark_fsdp.sh	[moe] merge moe into main (#4978)	2023-11-02 02:21:24 +00:00
hostfile.txt	[moe] merge moe into main (#4978)	2023-11-02 02:21:24 +00:00
utils.py	[moe] merge moe into main (#4978)	2023-11-02 02:21:24 +00:00