Making large AI models cheaper, faster and more accessible
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
 
 
 
 
 
HELSON 95c35f73bd
[moe] initialize MoE groups by ProcessGroup (#1640)
2 years ago
..
test_grad_handler.py [moe] fix moe bugs (#1633) 2 years ago
test_kernel.py [moe] fix moe bugs (#1633) 2 years ago
test_moe_colo_init.py [moe] initialize MoE groups by ProcessGroup (#1640) 2 years ago
test_moe_group.py
test_moe_zero_init.py [moe] fix moe bugs (#1633) 2 years ago
test_moe_zero_model.py [moe] fix moe bugs (#1633) 2 years ago
test_moe_zero_optim.py [moe] fix moe bugs (#1633) 2 years ago