Commit Graph

5 Commits (754f1d961a9b9d4b172c9a2e27386fe69a810d81)

Author SHA1 Message Date
Wenwen Qu 754f1d961a fix moe bugs in zero optimizer 2023-08-17 16:11:34 +08:00
Wenwen Qu c7f9d4f48c add expert data support and fix bugs 2023-08-10 16:07:35 +08:00
Wenwen Qu 9c8b999291 modified: internlm/model/moe.py
modified:   internlm/moe/sharded_moe.py
	modified:   internlm/utils/parallel.py
2023-08-08 16:46:14 +08:00
huangting4201 1f7304a8bb
feat(utils/logger.py): support uniscale logger (#152)
* style(internlm): fix lint error

* feat(utils/logger.py): support uniscale logger

* fix(utils/logger.py): fix import circular error

* feat(train.py): support dashboard metric panel and fix ci train config

* fix(ci_scripts/train/slurm_train.sh): fix ci train error

* fix(ci_scripts/train/torchrun.sh): fix ci train error

* fix(ci_scripts/train): restore ci update

* fix(config.json): delete alert webhook

* feat(train.py): optimize func init logger

* feat(config.json): delete config.json

---------

Co-authored-by: 黄婷 <huangting3@CN0014010744M.local>
Co-authored-by: huangting.p <huangting@sensetime.com>
2023-08-01 17:37:32 +08:00
Sun Peng fa7337b37b initial commit 2023-07-06 12:55:23 +08:00