8 Commits (9e512938f6b0b79c2d61c12d4fdc3b4a0008362e)

Author	SHA1	Message	Date
Wenhao Chen	3d8d5d0d58	[chat] use official transformers and fix some issues (#4117) ... * feat: remove on_learn_epoch fn as not used * revert: add _on_learn_epoch fn * feat: remove NaiveStrategy * test: update train_prompts tests * fix: remove prepare_llama_tokenizer_and_embedding * test: add lora arg * feat: remove roberta support in train_prompts due to runtime errs * feat: remove deberta & roberta in rm as not used * test: remove deberta and roberta tests * feat: remove deberta and roberta models as not used * fix: remove calls to roberta * fix: remove prepare_llama_tokenizer_and_embedding * chore: update transformers version * docs: update transformers version * fix: fix actor inference * fix: fix ci * feat: change llama pad token to unk * revert: revert ddp setup_distributed * fix: change llama pad token to unk * revert: undo unnecessary changes * fix: use pip to install transformers	2023-07-04 13:49:09 +08:00
Wenhao Chen	edd75a59ea	[chat] remove naive strategy and split colossalai strategy (#4094) ... * feat: remove on_learn_epoch fn as not used * revert: add _on_learn_epoch fn * to: remove the use of NaiveStrategy * test: remove NaiveStrategy tests * feat: remove NaiveStrategy * style: modify comments and params * feat: split ColossalAIStrategy into LowLevelZeroStrategy and GeminiStrategy * fix: remove naive * fix: align with modified colossal strategy * fix: fix ddp _try_init_dist arg	2023-06-29 18:11:00 +08:00
Wenhao Chen	b03d64d010	[chat] refactor trainer class (#4080) ... * to: add SLTrainer * refactor: refactor RMTrainer and SFTTrainer * fix: fix init file * feat: remove on_learn_epoch fn as not used * fix: align with modified gemini arguments * to: add OnPolicyTrainer * revert: add _on_learn_epoch fn * refactor: refactor PPOTrainer * style: rename PPOTrainer argument * fix: align with modified PPO arguments * test: align with modified train_prompts arguments * chore: modify train_prompts * docs: align with modified arguments * fix: remove unnecessary output * fix: move dataloader to fit fn of SLTrainer * fix: move dataloader to fit fn of OnPolicyTrainer * fix: modify usage of prompt and pretrain dataloader	2023-06-29 10:48:09 +08:00
digger-yu	ad6460cf2c	[NFC] fix typo applications/ and colossalai/ (#3735)	2023-05-15 11:46:25 +08:00
digger-yu	65bdc3159f	fix some spelling error with applications/Chat/examples/ (#3692) ... * fix spelling error with examples/comminity/ * fix spelling error with example/	2023-05-06 11:27:23 +08:00
tanitna	1a60dc07a8	[chat] typo accimulation_steps -> accumulation_steps (#3662)	2023-04-28 15:42:57 +08:00
digger-yu	d7bf284706	[chat] polish code note typo (#3612)	2023-04-20 17:22:15 +08:00
Fazzie-Maqianli	6afeb1202a	add community example dictionary (#3465)	2023-04-06 15:04:48 +08:00