mirror of https://github.com/hpcaitech/ColossalAI
![]() * adapt model weight initialization for methods in Pytorch nn.init |
||
---|---|---|
.. | ||
test_grad_handler.py | ||
test_kernel.py | ||
test_moe_group.py | ||
test_moe_zero_init.py | ||
test_moe_zero_model.py | ||
test_moe_zero_optim.py |