Commit Graph

3 Commits (a1f99b64bc8cd0457529a9dc2ef3563d33d82491)

Author SHA1 Message Date
Wenwen Qu 9c8b999291 modified: internlm/model/moe.py
modified:   internlm/moe/sharded_moe.py
	modified:   internlm/utils/parallel.py
2023-08-08 16:46:14 +08:00
Wenwen Qu 5b6cf7cab0 reformat code 2023-08-08 15:07:04 +08:00
Wenwen Qu c357288a8b feat(XXX): add moe 2023-08-07 20:17:49 +08:00