You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
ColossalAI/colossalai/moe
digger yu 5e1c93d732
[hotfix] fix typo change MoECheckpintIO to MoECheckpointIO (#5335)
9 months ago
..
__init__.py [hotfix] fix typo change MoECheckpintIO to MoECheckpointIO (#5335) 9 months ago
_operation.py [moe] support mixtral (#5309) 10 months ago
checkpoint.py [hotfix] fix typo change MoECheckpintIO to MoECheckpointIO (#5335) 9 months ago
experts.py [moe] init mixtral impl 10 months ago
layers.py [moe] init mixtral impl 10 months ago
load_balance.py [moe] merge moe into main (#4978) 1 year ago
loss.py [moe] merge moe into main (#4978) 1 year ago
manager.py fix some typo (#5307) 10 months ago
routers.py [moe] fix tests 10 months ago
utils.py [moe] init mixtral impl 10 months ago