Wenwen Qu 375240e039 feat(moe): add local data parallel support for experts (#376) ... * add local data parallel support for experts * fix model checkpoint for local dp mode of expert * do not set ep size from config		2023-09-28 13:38:02 +08:00
..
__init__.py	feat(ckpt): fix checkpoint bugs and add feature enhancements. (#259)	2023-09-05 17:40:48 +08:00
hybrid_zero_optim.py	feat(moe): add local data parallel support for experts (#376)	2023-09-28 13:38:02 +08:00
store.py	feat(moe): add local data parallel support for experts (#376)	2023-09-28 13:38:02 +08:00
utils.py	feat(moe): add moe module (#182)	2023-09-27 15:54:53 +08:00