4 Commits (a8dd77ce76a5be5e12c1106d488f7321e9986e19)

Author	SHA1	Message	Date
Wenwen Qu	929dd36cf2	avoid moe parameter partition in zero optimizer	2023-08-15 17:52:51 +08:00
Wenwen Qu	9c8b999291	modified: internlm/model/moe.py ... modified: internlm/moe/sharded_moe.py modified: internlm/utils/parallel.py	2023-08-08 16:46:14 +08:00
Wenwen Qu	5b6cf7cab0	reformat code	2023-08-08 15:07:04 +08:00
Wenwen Qu	c357288a8b	feat(XXX): add moe	2023-08-07 20:17:49 +08:00