InternLM/tests/test_utils
Wenwen Qu 582ee000bd
feat(moe):support zero for expert local dp (#404)
* support zero for expert local dp

* fix above codes:
    *treat optim.zero_world_size and optim.zero_local_rank as list in model_checkpoint.py and test_model_checkpoint.py
    *add overlap and zero check for moe in args_sanity_check(.)
2023-10-09 17:45:26 +08:00
..
common_fixture.py feat(moe): add moe module (#182) 2023-09-27 15:54:53 +08:00
test_model_checkpoint.py feat(moe):support zero for expert local dp (#404) 2023-10-09 17:45:26 +08:00
test_storage_manager.py fix(storage): fix try_get_storage_backend (#359) 2023-09-25 15:16:25 +08:00
test_timeout.py feat(utils): add timeout warpper for key functions (#286) 2023-09-07 17:26:17 +08:00