Wenwen Qu 375240e039 feat(moe): add local data parallel support for experts (#376) ... * add local data parallel support for experts * fix model checkpoint for local dp mode of expert * do not set ep size from config		2023-09-28 13:38:02 +08:00
..
__init__.py	Feat/add runntime gpu test (#254)	2023-09-01 13:38:01 +08:00
parallel_context.py	feat(moe): add local data parallel support for experts (#376)	2023-09-28 13:38:02 +08:00
process_group_initializer.py	feat(moe): add moe module (#182)	2023-09-27 15:54:53 +08:00
random.py	initial commit	2023-07-06 12:55:23 +08:00