ColossalAI

Commit Graph

Author	SHA1	Message	Date
Fazzie-Maqianli	6afeb1202a	add community example dictionary (#3465 )	2023-04-06 15:04:48 +08:00
YY Lin	62f4e2eb07	[Chat]Add Peft support & fix the ptx bug (#3433 ) * Update ppo.py Fix the bug of fetching wrong batch data * Add peft model support in SFT and Prompts training In stage-1 and stage-3, the peft model supports are added. So the trained artifacts will be only a small lora additions instead of the whole bunch of files. * Delete test_prompts.txt * Delete test_pretrained.txt * Move the peft stuffs to a community folder. * Move the demo sft to community * delete dirty files * Add instructions to install peft using source * Remove Chinese comments * remove the Chinese comments	2023-04-06 11:54:52 +08:00

Author

SHA1

Message

Date

Fazzie-Maqianli

6afeb1202a

add community example dictionary (#3465 )

2023-04-06 15:04:48 +08:00

YY Lin

62f4e2eb07

[Chat]Add Peft support & fix the ptx bug (#3433 )

* Update ppo.py

Fix the bug of fetching wrong batch data

* Add peft model support in SFT and Prompts training

In stage-1 and stage-3, the peft model supports are added. So the trained artifacts will be only a small lora additions instead of the whole bunch of files.

* Delete test_prompts.txt

* Delete test_pretrained.txt

* Move the peft stuffs to a community folder.

* Move the demo sft to community

* delete dirty files

* Add instructions to install peft using source

* Remove Chinese comments

* remove the Chinese comments

2023-04-06 11:54:52 +08:00

2 Commits (ab5fd127e393f7298c6497fd638d0f89c53a9452)