5 Commits (428b5d2f33bc30f85852fb28afcf41a79a8f15cc)

Author	SHA1	Message	Date
Wenwen Qu	12c614db94	create expert data group and broadcast moe parameter in expert data group	2023-08-21 11:40:39 +08:00
Wenwen Qu	c7f9d4f48c	add expert data support and fix bugs	2023-08-10 16:07:35 +08:00
Wenwen Qu	84476833f3	modified: internlm/core/context/process_group_initializer.py ... modified: internlm/core/scheduler/no_pipeline_scheduler.py modified: internlm/solver/optimizer/hybrid_zero_optim.py	2023-08-08 15:59:12 +08:00
Wenwen Qu	c357288a8b	feat(XXX): add moe	2023-08-07 20:17:49 +08:00
Sun Peng	fa7337b37b	initial commit	2023-07-06 12:55:23 +08:00