Camille Zhong 72cb4dd433 [Chat] fix the tokenizer "int too big to convert" error in SFT training (#3453) ... * Add RoBERTa for RLHF Stage 2 & 3 (test) RoBERTa for RLHF Stage 2 & 3 (still in testing) * Revert "Add RoBERTa for RLHF Stage 2 & 3 (test)" This reverts commit 06741d894d. * Add RoBERTa for RLHF stage 2 & 3 1. add roberta folder under model folder 2. add roberta option in train_reward_model.py 3. add some test in testci * Update test_ci.sh * Revert "Update test_ci.sh" This reverts commit 9c7352b81766f3177d31eeec0ec178a301df966a. * Add RoBERTa for RLHF Stage 2 & 3 (test) RoBERTa for RLHF Stage 2 & 3 (still in testing) * Revert "Add RoBERTa for RLHF Stage 2 & 3 (test)" This reverts commit 06741d894d. * Add RoBERTa for RLHF stage 2 & 3 1. add roberta folder under model folder 2. add roberta option in train_reward_model.py 3. add some test in testci * Update test_ci.sh * Revert "Update test_ci.sh" This reverts commit 9c7352b81766f3177d31eeec0ec178a301df966a. * update roberta with coati * chat ci update * Revert "chat ci update" This reverts commit 17ae7ae01fa752bd3289fc39069868fde99cf846. * [Chat] fix the tokenizer "int too big to convert" error in SFT training fix the tokenizer error during SFT training using Bloom and OPT		2023-04-06 09:30:28 +08:00
..
__init__.py	[Coati] first commit (#3283)	2023-03-28 20:25:36 +08:00
prompt_dataset.py	[Coati] first commit (#3283)	2023-03-28 20:25:36 +08:00
reward_dataset.py	[Coati] first commit (#3283)	2023-03-28 20:25:36 +08:00
sft_dataset.py	[Chat] fix the tokenizer "int too big to convert" error in SFT training (#3453)	2023-04-06 09:30:28 +08:00
utils.py	[Coati] first commit (#3283)	2023-03-28 20:25:36 +08:00