Commit Graph

3 Commits (9c8b9992913773dadee1601699c6a7c08f24c1f3)

Author SHA1 Message Date
Wenwen Qu 9c8b999291 modified: internlm/model/moe.py
modified:   internlm/moe/sharded_moe.py
	modified:   internlm/utils/parallel.py
2023-08-08 16:46:14 +08:00
Wenwen Qu 8b198b2665 modified: .pre-commit-config.yaml
modified:   internlm/model/moe.py
	modified:   internlm/model/modeling_internlm.py
2023-08-08 15:44:37 +08:00
Wenwen Qu c357288a8b feat(XXX): add moe 2023-08-07 20:17:49 +08:00