github
/
ColossalAI
mirror of https://github.com/hpcaitech/ColossalAI
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
ColossalAI/tests/test_moe
History
Xuanlei Zhao f71e63b0f3
[moe] support optimizer checkpoint (#5015) 
* Refactor MoE Manager setup method

* unshard optim ckpt

* optim io

* update transformer version

* update requirements

* update ckpt

* update ckpt

* update ckpt

* fix engine

* fix engine
 		2023-11-08 15:07:03 +00:00
..
moe_utils.py [moe] merge moe into main (#4978) 2023-11-02 02:21:24 +00:00
test_grad_handler.py [moe] support optimizer checkpoint (#5015) 2023-11-08 15:07:03 +00:00
test_kernel.py [moe] support optimizer checkpoint (#5015) 2023-11-08 15:07:03 +00:00
test_moe_checkpoint.py [moe] support optimizer checkpoint (#5015) 2023-11-08 15:07:03 +00:00
test_moe_ep_tp.py [moe] support optimizer checkpoint (#5015) 2023-11-08 15:07:03 +00:00
test_moe_group.py [moe] support optimizer checkpoint (#5015) 2023-11-08 15:07:03 +00:00
test_moe_hybrid_zero.py [moe] support optimizer checkpoint (#5015) 2023-11-08 15:07:03 +00:00
test_moe_load_balance.py [moe] support optimizer checkpoint (#5015) 2023-11-08 15:07:03 +00:00
test_moe_router.py [moe] merge moe into main (#4978) 2023-11-02 02:21:24 +00:00
test_moe_zero_fwd_bwd.py [moe] support optimizer checkpoint (#5015) 2023-11-08 15:07:03 +00:00
test_moe_zero_optim.py [moe] support optimizer checkpoint (#5015) 2023-11-08 15:07:03 +00:00