You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
ColossalAI/applications/ColossalMoE/colossal_moe/models
Hongxin Liu 65e5d6baa5
[moe] fix mixtral optim checkpoint (#5344)
10 months ago
..
__init__.py [moe] init mixtral impl 10 months ago
mixtral_checkpoint.py [moe] fix mixtral optim checkpoint (#5344) 10 months ago
mixtral_layer.py [moe] support mixtral (#5309) 10 months ago
mixtral_policy.py [moe] fix mixtral forward default value (#5329) 10 months ago