github
/
ColossalAI
mirror of https://github.com/hpcaitech/ColossalAI
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
2,209 Commits
32 Branches
46 Tags
229 MiB
Commit Graph

69 Commits (fee2af861078181e18a059800ba09a4edfb311f0)

Author SHA1 Message Date
Andrew 82132f4e3d
[chat] correcting a few obvious typos and grammars errors (#3338) 2023-03-30 14:18:37 +08:00
Fazzie-Maqianli 0fbadce79c
[doc] added authors to the chat application (#3307) 2023-03-29 11:04:30 +08:00
BlueRum b512893637
Polish readme link (#3306) 2023-03-29 10:25:50 +08:00
github-actions[bot] cb413ccf28
[format] applied code formatting on changed files in pull request 3300 (#3302) 
Co-authored-by: github-actions <github-actions@github.com>
 2023-03-29 09:28:24 +08:00
binmakeswell 31c78f2be3
[doc] add ColossalChat news (#3304) 
* [doc] add ColossalChat news

* [doc] add ColossalChat news
 2023-03-29 09:27:55 +08:00
Frank Lee e235a24673
[application] updated the README (#3301) 
* [application] updated the README

* polish code
 2023-03-29 08:47:00 +08:00
BlueRum 8257e1055d
[chat]polish prompts training (#3300) 
* polish train_prompts

* polish readme
 2023-03-29 08:44:16 +08:00
ver217 62f7156131
[coati] fix inference profanity check (#3299) 2023-03-29 04:26:35 +08:00
github-actions[bot] 5134ad5d1a
[format] applied code formatting on changed files in pull request 3296 (#3298) 
Co-authored-by: github-actions <github-actions@github.com>
 2023-03-29 02:35:40 +08:00
BlueRum c8b723d6c2
[chat]Update Readme (#3296) 
* Update README.md

* Update README.md

* Update README.md

* update example readme
 2023-03-29 02:32:17 +08:00
ver217 73b542a124
[coati] inference supports profanity check (#3295) 2023-03-29 02:14:35 +08:00
ver217 ce2cafae76
[coati] add repetition_penalty for inference (#3294) 2023-03-29 01:18:45 +08:00
Fazzie-Maqianli a88ed0f83a
add limit (#3293) 2023-03-29 00:53:23 +08:00
Fazzie-Maqianli c5484281aa
[ColossalChat]add cite for datasets (#3292) 2023-03-29 00:38:36 +08:00
Fazzie-Maqianli ec7af22a43
fix image (#3288) 2023-03-28 23:34:21 +08:00
Fazzie-Maqianli 1f7d9afbf8
add example (#3286) 2023-03-28 23:07:15 +08:00
ver217 4905b21b94
[coati] fix inference output (#3285) 
* [coati] fix inference requirements

* [coati] add output postprocess

* [coati] update inference readme

* [coati] fix inference requirements
 2023-03-28 21:20:28 +08:00
Fazzie-Maqianli bb6196e71a
remove chatgpt (#3284) 2023-03-28 20:29:09 +08:00
Fazzie-Maqianli b0ce5a1032
[Coati] first commit (#3283) 2023-03-28 20:25:36 +08:00
binmakeswell d32ef94ad9
[doc] fix typo (#3222) 
* [doc] fix typo

* [doc] fix typo
 2023-03-24 13:33:35 +08:00
ver217 78fd31f9c1
[chatgpt] add precision option for colossalai (#3233) 2023-03-24 12:15:06 +08:00
Fazzie-Maqianli bd39877da4
support instrcut training (#3230) 2023-03-24 11:45:01 +08:00
Camille Zhong 9bc702ab48
[doc] update chatgpt doc paper link (#3229) 
#issue 3189
 2023-03-24 11:21:39 +08:00
Fazzie-Maqianli bbac6760e5
fix torch version (#3225) 2023-03-23 20:56:35 +08:00
Fazzie-Maqianli fa97a9cab4
[chatgpt] unnify datasets (#3218) 2023-03-23 17:38:30 +08:00
Fazzie-Maqianli 4fd4bd9d9a
[chatgpt] support instuct training (#3216) 2023-03-23 16:46:20 +08:00
Yuanchen 9998d5ef64
[chatgpt]add reward model code for deberta (#3199) 
Co-authored-by: Yuanchen Xu <yuanchen.xu00@gmail.com>
 2023-03-22 19:09:39 +08:00
Fazzie-Maqianli 1e1b9d2fea
[chatgpt]support llama (#3070) 2023-03-22 15:44:31 +08:00
pgzhang b429529365
[chatgpt] add supervised learning fine-tune code (#3183) 
* [chatgpt] add supervised fine-tune code

* [chatgpt] delete unused code and modified comment code

* [chatgpt] use pytorch distributed sampler instead

---------

Co-authored-by: zhangpengpeng <zhangpengpeng@joyy.com>
 2023-03-22 09:59:42 +08:00
BlueRum 7548ca5a54
[chatgpt]Reward Model Training Process update (#3133) 
* add normalize function to value_head in bloom rm

* add normalization to value_function in gpt_rm

* add normalization to value_head of opt_rm

* add Anthropic/hh-rlhf dataset

* Update __init__.py

* Add LogExpLoss in RM training

* Update __init__.py

* update rm trainer to use acc as target

* update example/train_rm

* Update train_rm.sh

* code style

* Update README.md

* Update README.md

* add rm test to ci

* fix tokenier

* fix typo

* change batchsize to avoid oom in ci

* Update test_ci.sh
 2023-03-20 09:59:06 +08:00
ver217 1e58d31bb7
[chatgpt] fix trainer generate kwargs (#3166) 2023-03-17 17:31:22 +08:00
ver217 c474fda282
[chatgpt] fix ppo training hanging problem with gemini (#3162) 
* [chatgpt] fix generation early stopping

* [chatgpt] fix train prompts example
 2023-03-17 15:41:47 +08:00
binmakeswell 3c01280a56
[doc] add community contribution guide (#3153) 
* [doc] update contribution guide

* [doc] update contribution guide

* [doc] add community contribution guide
 2023-03-17 11:07:24 +08:00
BlueRum 23cd5e2ccf
[chatgpt]update ci (#3087) 
* [chatgpt]update ci

* Update test_ci.sh

* Update test_ci.sh

* Update test_ci.sh

* test

* Update train_prompts.py

* Update train_dummy.py

* add save_path

* polish

* add save path

* polish

* add save path

* polish

* delete bloom-560m test

delete bloom-560m test because of oom

* add ddp test
 2023-03-14 11:01:17 +08:00
BlueRum 68577fbc43
[chatgpt]Fix examples (#3116) 
* fix train_dummy

* fix train-prompts
 2023-03-13 11:12:22 +08:00
BlueRum 0672b5afac
[chatgpt] fix lora support for gpt (#3113) 
* fix gpt-actor

* fix gpt-critic

* fix opt-critic
 2023-03-13 10:37:41 +08:00
hiko2MSP 191daf7411
[chatgpt] type miss of kwargs (#3107) 2023-03-13 00:00:02 +08:00
BlueRum c9dd036592
[chatgpt] fix lora save bug (#3099) 
* fix colo-stratergy

* polish

* fix lora

* fix ddp

* polish

* polish
 2023-03-10 17:58:10 +08:00
Fazzie-Maqianli 02ae80bf9c
[chatgpt]add flag of action mask in critic(#3086) 2023-03-10 14:40:14 +08:00
wenjunyang b51bfec357
[chatgpt] change critic input as state (#3042) 
* fix Critic

* fix Critic

* fix Critic

* fix neglect of attention mask

* fix neglect of attention mask

* fix neglect of attention mask

* add return

---------

Co-authored-by: yangwenjun <yangwenjun@soyoung.com>
Co-authored-by: yangwjd <yangwjd@chanjet.com>
 2023-03-08 15:18:02 +08:00
Fazzie-Maqianli c21b11edce
change nn to models (#3032) 2023-03-07 16:34:22 +08:00
github-actions[bot] e86d9bb2e1
[format] applied code formatting on changed files in pull request 3025 (#3026) 
Co-authored-by: github-actions <github-actions@github.com>
 2023-03-07 12:55:17 +08:00
BlueRum 55dcd3051a
[chatgpt] fix readme (#3025) 2023-03-07 10:21:25 +08:00
LuGY 287d60499e
[chatgpt] Add saving ckpt callback for PPO (#2880) 
* add checkpoint callback for chatgpt

* add save ckpt callbacks for ppo

---------

Co-authored-by: Fazzie-Maqianli <55798671+Fazziekey@users.noreply.github.com>
 2023-03-07 10:13:25 +08:00
BlueRum e588703454
[chatgpt]fix inference model load (#2988) 
* fix lora bug

* polish

* fix lora gemini

* fix inference laod model bug
 2023-03-07 09:17:52 +08:00
ver217 0ff8406b00
[chatgpt] allow shard init and display warning (#2986) 2023-03-03 16:27:59 +08:00
BlueRum f5ca0397dd
[chatgpt] fix lora gemini conflict in RM training (#2984) 
* fix lora bug

* polish

* fix lora gemini
 2023-03-03 15:58:16 +08:00
ver217 19ad49fb3b
[chatgpt] making experience support dp (#2971) 
* [chatgpt] making experience support dp

* [chatgpt] update example test ci

* [chatgpt] update example test ci

* [chatgpt] update example test ci

* [chatgpt] update example test ci

* [chatgpt] update sampler

* [chatgpt] update example test ci

* [chatgpt] refactor sampler

* [chatgpt] update example test ci
 2023-03-03 15:51:19 +08:00
BlueRum c9e27f0d1b
[chatgpt]fix lora bug (#2974) 
* fix lora bug

* polish
 2023-03-02 17:51:44 +08:00
BlueRum 82149e9d1b
[chatgpt] fix inference demo loading bug (#2969) 
* [chatgpt] fix inference demo loading bug

* polish
 2023-03-02 16:18:33 +08:00