Wenwen Qu 375240e039 feat(moe): add local data parallel support for experts (#376) ... * add local data parallel support for experts * fix model checkpoint for local dp mode of expert * do not set ep size from config		2023-09-28 13:38:02 +08:00
..
__init__.py	Merge develop to main (#233)	2023-08-24 22:03:04 +08:00
training_internlm.py	feat(moe): add local data parallel support for experts (#376)	2023-09-28 13:38:02 +08:00
utils.py	feat(moe): add moe module (#182)	2023-09-27 15:54:53 +08:00