3 Commits (f8eaf618af882056a25a5b73ea57ea6308b5877a)

Author	SHA1	Message	Date
jiaxingli	bbb5651582	fix(model): change model_type `LLAMA` to `LLAMA2` (#539) ... * support hf llama * support hf llama * support hf llama * support hf llama * importerror * importerror * modeling * modeling * fix bug	2023-12-13 17:24:45 +08:00
huangting4201	762ab297ee	feat(core/scheduler): support pipeline parallel (#98) ... * feat(utils/writer.py): support tensorboard writer * feat(utils/writer.py): add class comment * feat(core): support pipeline parallel * fix(core): fix demo running error * feat(solver/optimizer): add pp zero optimizer * fix(solver/optimizer): fix word spelling error * feat(core/scheduler): add new dir scheduler in core/ * fix(core): fix ci lint error * feat(solver/optimizer): merge pp and nopp optimizer * doc(usage.md): update usage doc * feat(core/scheduler): support post func * feat(core/scheduler): add dtype para in pp sche and update func get_tensor_shape * feat(core/scheduler): add _load_micro_batch in base scheduler * feat(core/scheduler): support optimizer overlap communication in pp scheduler * feat(core/scheduler): delete data process func code * feat(core/trainer): schedule pre processing for all schedule --------- Co-authored-by: 黄婷 <huangting3@CN0014010744M.local> Co-authored-by: huangting.p <huangting@sensetime.com>	2023-07-24 20:52:09 +08:00
Sun Peng	fa7337b37b	initial commit	2023-07-06 12:55:23 +08:00