ColossalAI/colossalai/tensor/moe_tensor
Xuanlei Zhao f71e63b0f3
[moe] support optimizer checkpoint (#5015)
* Refactor MoE Manager setup method

* unshard optim ckpt

* optim io

* update transformer version

* update requirements

* update ckpt

* update ckpt

* update ckpt

* fix engine

* fix engine
2023-11-08 15:07:03 +00:00
..
__init__.py [moe] merge moe into main (#4978) 2023-11-02 02:21:24 +00:00
api.py [moe] support optimizer checkpoint (#5015) 2023-11-08 15:07:03 +00:00
moe_info.py [moe] merge moe into main (#4978) 2023-11-02 02:21:24 +00:00