ColossalAI/applications/Chat/coati/trainer
YY Lin 62f4e2eb07
[Chat]Add Peft support & fix the ptx bug (#3433)
* Update ppo.py

Fix the bug of fetching wrong batch data

* Add peft model support in SFT and Prompts training

In stage-1 and stage-3, the peft model supports are added. So the trained artifacts will be only a small lora additions instead of the whole bunch of files.

* Delete test_prompts.txt

* Delete test_pretrained.txt

* Move the peft stuffs to a community folder.

* Move the demo sft to community

* delete dirty files

* Add instructions to install peft using source

* Remove Chinese comments

* remove the Chinese comments
2023-04-06 11:54:52 +08:00
..
callbacks [Coati] first commit (#3283) 2023-03-28 20:25:36 +08:00
strategies fix save_model inin naive and ddp strategy (#3436) 2023-04-04 15:30:01 +08:00
__init__.py [Coati] first commit (#3283) 2023-03-28 20:25:36 +08:00
base.py [Coati] first commit (#3283) 2023-03-28 20:25:36 +08:00
ppo.py [Chat]Add Peft support & fix the ptx bug (#3433) 2023-04-06 11:54:52 +08:00
rm.py [Coati] first commit (#3283) 2023-03-28 20:25:36 +08:00
sft.py [Coati] first commit (#3283) 2023-03-28 20:25:36 +08:00
utils.py [Coati] first commit (#3283) 2023-03-28 20:25:36 +08:00