huangting4201 e7f9f1d208 feat(model/overlap_handler.py): optimize reduce scatter mem pool		2023-10-23 13:31:23 +08:00
..
__init__.py	feat(train): add fsdp training option (#293)	2023-10-09 18:59:31 +08:00
base_optimizer.py	feat(train): add fsdp training option (#293)	2023-10-09 18:59:31 +08:00
fsdp_optimizer.py	feat(train): add fsdp training option (#293)	2023-10-09 18:59:31 +08:00
hybrid_zero_optim.py	feat(model/overlap_handler.py): optimize reduce scatter mem pool	2023-10-23 13:31:23 +08:00
store.py	feat(optimizer/hybrid_zero_optim.py): fix lint error	2023-10-20 16:22:29 +08:00
utils.py	feat(moe):support zero for expert local dp (#404)	2023-10-09 17:45:26 +08:00