Wenwen Qu 582ee000bd feat(moe):support zero for expert local dp (#404) ... * support zero for expert local dp * fix above codes: *treat optim.zero_world_size and optim.zero_local_rank as list in model_checkpoint.py and test_model_checkpoint.py *add overlap and zero check for moe in args_sanity_check(.)		2023-10-09 17:45:26 +08:00
..
test_model	Feat(norm)/support fused precision (#319)	2023-09-26 20:39:55 +08:00
test_solver	feat: add optimizer_unitest (#303)	2023-09-15 18:56:56 +08:00
test_training	feat(moe): add moe module (#182)	2023-09-27 15:54:53 +08:00
test_utils	feat(moe):support zero for expert local dp (#404)	2023-10-09 17:45:26 +08:00
__init__.py	fix(storage): fix and refactor storage api (#281)	2023-09-06 01:15:09 +08:00