ColossalAI/tests/test_moe
HELSON d7ecaf362b
[zero] fix init bugs in zero context (#686)
* adapt model weight initialization for methods in Pytorch nn.init
2022-04-07 17:38:45 +08:00
..
test_grad_handler.py Refactored docstring to google style 2022-03-29 17:17:47 +08:00
test_kernel.py Refactored docstring to google style 2022-03-29 17:17:47 +08:00
test_moe_group.py Refactored docstring to google style 2022-03-29 17:17:47 +08:00
test_moe_zero_init.py [zero] fix init bugs in zero context (#686) 2022-04-07 17:38:45 +08:00
test_moe_zero_model.py [zero] fix init bugs in zero context (#686) 2022-04-07 17:38:45 +08:00
test_moe_zero_optim.py [zero] fix init bugs in zero context (#686) 2022-04-07 17:38:45 +08:00