Commit Graph

6 Commits (7ca5da27e8679723cd42d38fc7b00dbf3a8febdd)

Author SHA1 Message Date
Wenwen Qu b021995199 fix bugs 2023-08-30 16:14:33 +08:00
Wenwen Qu f3da80a7ca reformat code 2023-08-28 14:46:03 +08:00
Wenwen Qu 0e6b1f856c add support for moe checkpoint 2023-08-24 17:01:14 +08:00
Wenwen Qu 9c8b999291 modified: internlm/model/moe.py
modified:   internlm/moe/sharded_moe.py
	modified:   internlm/utils/parallel.py
2023-08-08 16:46:14 +08:00
Wenwen Qu 5b6cf7cab0 reformat code 2023-08-08 15:07:04 +08:00
Wenwen Qu c357288a8b feat(XXX): add moe 2023-08-07 20:17:49 +08:00