mirror of https://github.com/InternLM/InternLM
![]() * support zero for expert local dp * fix above codes: *treat optim.zero_world_size and optim.zero_local_rank as list in model_checkpoint.py and test_model_checkpoint.py *add overlap and zero check for moe in args_sanity_check(.) |
||
---|---|---|
.. | ||
common_fixture.py | ||
test_model_checkpoint.py | ||
test_storage_manager.py | ||
test_timeout.py |