Wenwen Qu 86bcda5ca9 add default setting for expert parallel size		2023-08-24 18:52:12 +08:00
..
__init__.py	initial commit	2023-07-06 12:55:23 +08:00
parallel_context.py	add default setting for expert parallel size	2023-08-24 18:52:12 +08:00
process_group_initializer.py	create expert data group and broadcast moe parameter in expert data group	2023-08-21 11:40:39 +08:00
random.py	initial commit	2023-07-06 12:55:23 +08:00