5 Commits (ac168bd9c19c1a68c1bf9f996f4ac75d34e894db)

Author	SHA1	Message	Date
Wenwen Qu	5f2e082b21	reformat code	2023-08-09 16:03:47 +08:00
zhanglei	cdf3ed9533	add residual and other moe features	2023-08-09 14:14:18 +08:00
Wenwen Qu	9c8b999291	modified: internlm/model/moe.py ... modified: internlm/moe/sharded_moe.py modified: internlm/utils/parallel.py	2023-08-08 16:46:14 +08:00
Wenwen Qu	8b198b2665	modified: .pre-commit-config.yaml ... modified: internlm/model/moe.py modified: internlm/model/modeling_internlm.py	2023-08-08 15:44:37 +08:00
Wenwen Qu	c357288a8b	feat(XXX): add moe	2023-08-07 20:17:49 +08:00