5 Commits (50e5602c2d6c8e25ad544cbecc38649e5257e7b8)

Author	SHA1	Message	Date
Wenhao Chen	b03d64d010	[chat] refactor trainer class (#4080) ... * to: add SLTrainer * refactor: refactor RMTrainer and SFTTrainer * fix: fix init file * feat: remove on_learn_epoch fn as not used * fix: align with modified gemini arguments * to: add OnPolicyTrainer * revert: add _on_learn_epoch fn * refactor: refactor PPOTrainer * style: rename PPOTrainer argument * fix: align with modified PPO arguments * test: align with modified train_prompts arguments * chore: modify train_prompts * docs: align with modified arguments * fix: remove unnecessary output * fix: move dataloader to fit fn of SLTrainer * fix: move dataloader to fit fn of OnPolicyTrainer * fix: modify usage of prompt and pretrain dataloader	2023-06-29 10:48:09 +08:00
Wenhao Chen	153b957a1b	[chat] refactor strategy class with booster api (#3987) ... * refactor: adapt boost API in base and naive strategies * fix: initialize plugin after setup_distributed * fix: fix save_pretrained fn * refactor: adapt boost API in DDPStrategy * to: add _post_init check * to: fix ddp backward, modify ddp dataloader and unwrap * feat: adapt boost API in ColossalAIStrategy * fix: call setup_distributed before use get_current_device * fix: fix save_model and save_optimizer * test: remove save_sharded_optimizer test * style: apply formatter * fix: fix stage check and add comments * feat: allow dict type arg in strategy.prepare * to: temporarily remove lr_scheduler for testing * style: simplify init of ColossalAIStrategy * fix: fix lr_scheduler in sft and rm * style: modify comments * test: add train_prompts tests * fix: fix inference only case and use in train_prompts * test: skip failed tests in ci * style: fix CodeFactor check * fix: do not use model.to('cpu') with GeminiPlugin * test: enable colossalai_gemini tests * test: set CUDA_VISIBLE_DEVICES in ci * docs: add note	2023-06-25 17:36:21 +08:00
Hongxin Liu	842768a174	[chat] refactor model save/load logic (#3654) ... * [chat] strategy refactor unwrap model * [chat] strategy refactor save model * [chat] add docstr * [chat] refactor trainer save model * [chat] fix strategy typing * [chat] refactor trainer save model * [chat] update readme * [chat] fix unit test	2023-04-27 18:41:49 +08:00
Yuanchen	1ec0d386a9	reconstruct chat trainer and fix training script (#3588) ... Co-authored-by: Yuanchen Xu <yuanchen.xu00@gmail.com>	2023-04-18 16:44:03 +08:00
Fazzie-Maqianli	b0ce5a1032	[Coati] first commit (#3283)	2023-03-28 20:25:36 +08:00