Commit Graph

9 Commits (aa7645a8312e2c7dc1ace36f03a233d0ec376d0b)

Author SHA1 Message Date
zhanglei 80972ff314 refactor code 2023-09-22 11:47:05 +08:00
Qu Wenwen 9665321745 refactor code 2023-09-21 11:51:17 +08:00
zhanglei edc18bcddd fix precision inconsistency 2023-09-18 20:54:52 +08:00
Wenwen Qu b021995199 fix bugs 2023-08-30 16:14:33 +08:00
Wenwen Qu f3da80a7ca reformat code 2023-08-28 14:46:03 +08:00
Wenwen Qu 0e6b1f856c add support for moe checkpoint 2023-08-24 17:01:14 +08:00
Wenwen Qu 9c8b999291 modified: internlm/model/moe.py
modified:   internlm/moe/sharded_moe.py
	modified:   internlm/utils/parallel.py
2023-08-08 16:46:14 +08:00
Wenwen Qu 5b6cf7cab0 reformat code 2023-08-08 15:07:04 +08:00
Wenwen Qu c357288a8b feat(XXX): add moe 2023-08-07 20:17:49 +08:00