ColossalAI/colossalai/moe
Xuanlei Zhao 6b69f3085b update 2024-01-03 15:37:59 +08:00
..
__init__.py update 2023-12-15 16:32:32 +08:00
_operation.py [hotfix]: modify create_ep_hierarchical_group and add test (#5032) 2023-11-17 10:53:00 +08:00
checkpoint.py update 2024-01-03 15:37:59 +08:00
experts.py update 2023-12-15 16:32:32 +08:00
layers.py update 2023-12-15 16:32:32 +08:00
load_balance.py [moe] merge moe into main (#4978) 2023-11-02 02:21:24 +00:00
loss.py [moe] merge moe into main (#4978) 2023-11-02 02:21:24 +00:00
manager.py [moe] support optimizer checkpoint (#5015) 2023-11-08 15:07:03 +00:00
routers.py update utils and fwd bwd 2023-12-28 18:54:56 +08:00
utils.py update 2023-12-15 16:32:32 +08:00