26b7aac0be
[zero] reorganize zero/gemini folder structure ( #3424 )
...
* [zero] refactor low-level zero folder structure
* [zero] fix legacy zero import path
* [zero] fix legacy zero import path
* [zero] remove useless import
* [zero] refactor gemini folder structure
* [zero] refactor gemini folder structure
* [zero] refactor legacy zero import path
* [zero] refactor gemini folder structure
* [zero] refactor gemini folder structure
* [zero] refactor gemini folder structure
* [zero] refactor legacy zero import path
* [zero] fix test import path
* [zero] fix test
* [zero] fix circular import
* [zero] update import
2023-04-04 13:48:16 +08:00
b09adff724
[chat]fix sft training for bloom, gpt and opt ( #3418 )
...
fix sft training for bloom, gpt and opt
2023-04-04 09:46:23 +08:00
30412866e0
[chatgpt] add pre-trained model RoBERTa for RLHF stage 2 & 3 ( #3223 )
...
* Add RoBERTa for RLHF Stage 2 & 3 (test)
RoBERTa for RLHF Stage 2 & 3 (still in testing)
* Revert "Add RoBERTa for RLHF Stage 2 & 3 (test)"
This reverts commit 06741d894d06741d894d
2023-04-03 10:11:03 +08:00
82132f4e3d
[chat] correcting a few obvious typos and grammars errors ( #3338 )
2023-03-30 14:18:37 +08:00
0fbadce79c
[doc] added authors to the chat application ( #3307 )
2023-03-29 11:04:30 +08:00
b512893637
Polish readme link ( #3306 )
2023-03-29 10:25:50 +08:00
cb413ccf28
[format] applied code formatting on changed files in pull request 3300 ( #3302 )
...
Co-authored-by: github-actions <github-actions@github.com>
2023-03-29 09:28:24 +08:00
31c78f2be3
[doc] add ColossalChat news ( #3304 )
...
* [doc] add ColossalChat news
* [doc] add ColossalChat news
2023-03-29 09:27:55 +08:00
e235a24673
[application] updated the README ( #3301 )
...
* [application] updated the README
* polish code
2023-03-29 08:47:00 +08:00
8257e1055d
[chat]polish prompts training ( #3300 )
...
* polish train_prompts
* polish readme
2023-03-29 08:44:16 +08:00
62f7156131
[coati] fix inference profanity check ( #3299 )
2023-03-29 04:26:35 +08:00
5134ad5d1a
[format] applied code formatting on changed files in pull request 3296 ( #3298 )
...
Co-authored-by: github-actions <github-actions@github.com>
2023-03-29 02:35:40 +08:00
c8b723d6c2
[chat]Update Readme ( #3296 )
...
* Update README.md
* Update README.md
* Update README.md
* update example readme
2023-03-29 02:32:17 +08:00
73b542a124
[coati] inference supports profanity check ( #3295 )
2023-03-29 02:14:35 +08:00
ce2cafae76
[coati] add repetition_penalty for inference ( #3294 )
2023-03-29 01:18:45 +08:00
a88ed0f83a
add limit ( #3293 )
2023-03-29 00:53:23 +08:00
c5484281aa
[ColossalChat]add cite for datasets ( #3292 )
2023-03-29 00:38:36 +08:00
ec7af22a43
fix image ( #3288 )
2023-03-28 23:34:21 +08:00
1f7d9afbf8
add example ( #3286 )
2023-03-28 23:07:15 +08:00
4905b21b94
[coati] fix inference output ( #3285 )
...
* [coati] fix inference requirements
* [coati] add output postprocess
* [coati] update inference readme
* [coati] fix inference requirements
2023-03-28 21:20:28 +08:00
bb6196e71a
remove chatgpt ( #3284 )
2023-03-28 20:29:09 +08:00
b0ce5a1032
[Coati] first commit ( #3283 )
2023-03-28 20:25:36 +08:00
d32ef94ad9
[doc] fix typo ( #3222 )
...
* [doc] fix typo
* [doc] fix typo
2023-03-24 13:33:35 +08:00
78fd31f9c1
[chatgpt] add precision option for colossalai ( #3233 )
2023-03-24 12:15:06 +08:00
bd39877da4
support instrcut training ( #3230 )
2023-03-24 11:45:01 +08:00
9bc702ab48
[doc] update chatgpt doc paper link ( #3229 )
...
#issue 3189
2023-03-24 11:21:39 +08:00
bbac6760e5
fix torch version ( #3225 )
2023-03-23 20:56:35 +08:00
fa97a9cab4
[chatgpt] unnify datasets ( #3218 )
2023-03-23 17:38:30 +08:00
4fd4bd9d9a
[chatgpt] support instuct training ( #3216 )
2023-03-23 16:46:20 +08:00
9998d5ef64
[chatgpt]add reward model code for deberta ( #3199 )
...
Co-authored-by: Yuanchen Xu <yuanchen.xu00@gmail.com>
2023-03-22 19:09:39 +08:00
1e1b9d2fea
[chatgpt]support llama ( #3070 )
2023-03-22 15:44:31 +08:00
b429529365
[chatgpt] add supervised learning fine-tune code ( #3183 )
...
* [chatgpt] add supervised fine-tune code
* [chatgpt] delete unused code and modified comment code
* [chatgpt] use pytorch distributed sampler instead
---------
Co-authored-by: zhangpengpeng <zhangpengpeng@joyy.com>
2023-03-22 09:59:42 +08:00
7548ca5a54
[chatgpt]Reward Model Training Process update ( #3133 )
...
* add normalize function to value_head in bloom rm
* add normalization to value_function in gpt_rm
* add normalization to value_head of opt_rm
* add Anthropic/hh-rlhf dataset
* Update __init__.py
* Add LogExpLoss in RM training
* Update __init__.py
* update rm trainer to use acc as target
* update example/train_rm
* Update train_rm.sh
* code style
* Update README.md
* Update README.md
* add rm test to ci
* fix tokenier
* fix typo
* change batchsize to avoid oom in ci
* Update test_ci.sh
2023-03-20 09:59:06 +08:00
1e58d31bb7
[chatgpt] fix trainer generate kwargs ( #3166 )
2023-03-17 17:31:22 +08:00
c474fda282
[chatgpt] fix ppo training hanging problem with gemini ( #3162 )
...
* [chatgpt] fix generation early stopping
* [chatgpt] fix train prompts example
2023-03-17 15:41:47 +08:00
3c01280a56
[doc] add community contribution guide ( #3153 )
...
* [doc] update contribution guide
* [doc] update contribution guide
* [doc] add community contribution guide
2023-03-17 11:07:24 +08:00
23cd5e2ccf
[chatgpt]update ci ( #3087 )
...
* [chatgpt]update ci
* Update test_ci.sh
* Update test_ci.sh
* Update test_ci.sh
* test
* Update train_prompts.py
* Update train_dummy.py
* add save_path
* polish
* add save path
* polish
* add save path
* polish
* delete bloom-560m test
delete bloom-560m test because of oom
* add ddp test
2023-03-14 11:01:17 +08:00
68577fbc43
[chatgpt]Fix examples ( #3116 )
...
* fix train_dummy
* fix train-prompts
2023-03-13 11:12:22 +08:00
0672b5afac
[chatgpt] fix lora support for gpt ( #3113 )
...
* fix gpt-actor
* fix gpt-critic
* fix opt-critic
2023-03-13 10:37:41 +08:00
191daf7411
[chatgpt] type miss of kwargs ( #3107 )
2023-03-13 00:00:02 +08:00
c9dd036592
[chatgpt] fix lora save bug ( #3099 )
...
* fix colo-stratergy
* polish
* fix lora
* fix ddp
* polish
* polish
2023-03-10 17:58:10 +08:00
02ae80bf9c
[chatgpt]add flag of action mask in critic( #3086 )
2023-03-10 14:40:14 +08:00
b51bfec357
[chatgpt] change critic input as state ( #3042 )
...
* fix Critic
* fix Critic
* fix Critic
* fix neglect of attention mask
* fix neglect of attention mask
* fix neglect of attention mask
* add return
---------
Co-authored-by: yangwenjun <yangwenjun@soyoung.com>
Co-authored-by: yangwjd <yangwjd@chanjet.com>
2023-03-08 15:18:02 +08:00
c21b11edce
change nn to models ( #3032 )
2023-03-07 16:34:22 +08:00
e86d9bb2e1
[format] applied code formatting on changed files in pull request 3025 ( #3026 )
...
Co-authored-by: github-actions <github-actions@github.com>
2023-03-07 12:55:17 +08:00
55dcd3051a
[chatgpt] fix readme ( #3025 )
2023-03-07 10:21:25 +08:00
287d60499e
[chatgpt] Add saving ckpt callback for PPO ( #2880 )
...
* add checkpoint callback for chatgpt
* add save ckpt callbacks for ppo
---------
Co-authored-by: Fazzie-Maqianli <55798671+Fazziekey@users.noreply.github.com>
2023-03-07 10:13:25 +08:00
e588703454
[chatgpt]fix inference model load ( #2988 )
...
* fix lora bug
* polish
* fix lora gemini
* fix inference laod model bug
2023-03-07 09:17:52 +08:00
0ff8406b00
[chatgpt] allow shard init and display warning ( #2986 )
2023-03-03 16:27:59 +08:00
f5ca0397dd
[chatgpt] fix lora gemini conflict in RM training ( #2984 )
...
* fix lora bug
* polish
* fix lora gemini
2023-03-03 15:58:16 +08:00
ver217