You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
ColossalAI/tests/test_moe
hxwang 46c069b0db
[zero] solve hang
4 months ago
..
moe_utils.py [test] add mixtral transformer test 4 months ago
test_deepseek_layer.py [shardformer] DeepseekMoE support (#5871) 5 months ago
test_grad_handler.py [MoE/ZeRO] Moe refactor with zero refactor (#5821) 5 months ago
test_kernel.py [MoE/ZeRO] Moe refactor with zero refactor (#5821) 5 months ago
test_mixtral_layer.py [MoE/ZeRO] Moe refactor with zero refactor (#5821) 5 months ago
test_moe_checkpoint.py [zero] solve hang 4 months ago
test_moe_ep_tp.py [MoE/ZeRO] Moe refactor with zero refactor (#5821) 5 months ago
test_moe_group.py [MoE/ZeRO] Moe refactor with zero refactor (#5821) 5 months ago
test_moe_hybrid_zero.py [MoE/ZeRO] Moe refactor with zero refactor (#5821) 5 months ago
test_moe_load_balance.py [MoE/ZeRO] Moe refactor with zero refactor (#5821) 5 months ago
test_moe_zero_fwd_bwd_optim.py [zero] solve hang 4 months ago