ColossalAI/applications/Chat/coati
Camille Zhong 72cb4dd433
[Chat] fix the tokenizer "int too big to convert" error in SFT training (#3453)
* Add RoBERTa for RLHF Stage 2 & 3 (test)

RoBERTa for RLHF Stage 2 & 3 (still in testing)

* Revert "Add RoBERTa for RLHF Stage 2 & 3 (test)"

This reverts commit 06741d894d.

* Add RoBERTa for RLHF stage 2 & 3

1. add roberta folder under model folder
2. add  roberta option in train_reward_model.py
3. add some test in testci

* Update test_ci.sh

* Revert "Update test_ci.sh"

This reverts commit 9c7352b81766f3177d31eeec0ec178a301df966a.

* Add RoBERTa for RLHF Stage 2 & 3 (test)

RoBERTa for RLHF Stage 2 & 3 (still in testing)

* Revert "Add RoBERTa for RLHF Stage 2 & 3 (test)"

This reverts commit 06741d894d.

* Add RoBERTa for RLHF stage 2 & 3

1. add roberta folder under model folder
2. add  roberta option in train_reward_model.py
3. add some test in testci

* Update test_ci.sh

* Revert "Update test_ci.sh"

This reverts commit 9c7352b81766f3177d31eeec0ec178a301df966a.

* update roberta with coati

* chat ci update

* Revert "chat ci update"

This reverts commit 17ae7ae01fa752bd3289fc39069868fde99cf846.

* [Chat] fix the tokenizer "int too big to convert" error in SFT training

fix the tokenizer error during SFT training using Bloom and OPT
2023-04-06 09:30:28 +08:00
..
dataset [Chat] fix the tokenizer "int too big to convert" error in SFT training (#3453) 2023-04-06 09:30:28 +08:00
experience_maker [Coati] first commit (#3283) 2023-03-28 20:25:36 +08:00
models [chat]fix sft training for bloom, gpt and opt (#3418) 2023-04-04 09:46:23 +08:00
replay_buffer [Coati] first commit (#3283) 2023-03-28 20:25:36 +08:00
trainer fix save_model indent error in ppo trainer (#3450) 2023-04-05 09:45:42 +08:00
utils [Coati] first commit (#3283) 2023-03-28 20:25:36 +08:00
__init__.py [Coati] first commit (#3283) 2023-03-28 20:25:36 +08:00