8 Commits (9665321745ee407962abfff916df14ff1dc52ec2)

Author	SHA1	Message	Date
Qu Wenwen	9665321745	refactor code	2023-09-21 11:51:17 +08:00
zhanglei	edc18bcddd	fix precision inconsistency	2023-09-18 20:54:52 +08:00
Wenwen Qu	b021995199	fix bugs	2023-08-30 16:14:33 +08:00
Wenwen Qu	f3da80a7ca	reformat code	2023-08-28 14:46:03 +08:00
Wenwen Qu	0e6b1f856c	add support for moe checkpoint	2023-08-24 17:01:14 +08:00
Wenwen Qu	9c8b999291	modified: internlm/model/moe.py ... modified: internlm/moe/sharded_moe.py modified: internlm/utils/parallel.py	2023-08-08 16:46:14 +08:00
Wenwen Qu	5b6cf7cab0	reformat code	2023-08-08 15:07:04 +08:00
Wenwen Qu	c357288a8b	feat(XXX): add moe	2023-08-07 20:17:49 +08:00