Commit Graph

6 Commits (fdbdfcff34de5b420cfddd3f7f86d856e3fea4f1)

Author SHA1 Message Date
gaoyang07 fdbdfcff34 remove micro_bsz 2023-11-25 22:44:20 +08:00
Yang Gao 6f69bd2087
feat(data): walk folder to get dataset_type_ids_map (#477)
* walk folder to get dataset_type_ids_map

* fix a bug
2023-11-07 19:21:10 +08:00
Yang Gao 4d1b1cd5f1
fix(data): broadcast list when walking folders (#475) 2023-11-07 13:12:35 +08:00
huangting4201 1f7304a8bb
feat(utils/logger.py): support uniscale logger (#152)
* style(internlm): fix lint error

* feat(utils/logger.py): support uniscale logger

* fix(utils/logger.py): fix import circular error

* feat(train.py): support dashboard metric panel and fix ci train config

* fix(ci_scripts/train/slurm_train.sh): fix ci train error

* fix(ci_scripts/train/torchrun.sh): fix ci train error

* fix(ci_scripts/train): restore ci update

* fix(config.json): delete alert webhook

* feat(train.py): optimize func init logger

* feat(config.json): delete config.json

---------

Co-authored-by: 黄婷 <huangting3@CN0014010744M.local>
Co-authored-by: huangting.p <huangting@sensetime.com>
2023-08-01 17:37:32 +08:00
ytxiong 5ee651c2f1
feat(*): support not-flash-attn for pp and no-pp (#145)
* support not flash attention for no-pp

* support pipeline

* modify the config

* refactor the code

* refactor the code

* remove some unnecessary code
2023-07-28 16:13:04 +08:00
Sun Peng fa7337b37b initial commit 2023-07-06 12:55:23 +08:00