89a9a600bc
[MCTS] Add self-refined MCTS ( #6098 )
...
* add reasoner
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* update code
* delete llama
* update prompts
* update readme
* update readme
---------
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-10-24 17:51:19 +08:00
4c8e85ee0d
[Coati] Train DPO using PP ( #6054 )
...
* update dpo
* remove unsupport plugin
* update msg
* update dpo
* remove unsupport plugin
* update msg
* update template
* update dataset
* add pp for dpo
* update dpo
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* add dpo fn
* update dpo
* update dpo
* update dpo
* update dpo
* minor update
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* update loss
* update help
* polish code
---------
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-10-11 19:32:00 +08:00
c650a906db
[Hotfix] Remove deprecated install ( #6042 )
...
* remove deprecated install
* remove unused folder
2024-09-03 10:33:18 +08:00
39e2597426
[ColossalChat] Add PP support ( #6001 )
...
* support pp training
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* update rm
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* refactor
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* update test case
* fix
* change to 4
* fix eval
* test
* add pp
* hotfix
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* support pp training
* update rm
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* refactor
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* update test case
* fix
* change to 4
* fix eval
* test
* add pp
* hotfix
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* update
* skip pp eval
* update all reduce
* update sft
* update ignore
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* update no cache
* add eval
* remove fi
* remove debug
* remove parentheses to avoid warning
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* Revert "add eval"
This reverts commit 3ab2f6fa32
2024-08-21 10:47:39 +08:00
ed97d3a5d3
[Chat] fix readme ( #5989 )
...
* fix readme
* fix readme, tokenization fully tested
* fix readme, tokenization fully tested
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
---------
Co-authored-by: root <root@notebook-8f919155-6035-47b4-9c6f-1be133b9e2c9-0.notebook-8f919155-6035-47b4-9c6f-1be133b9e2c9.colossal-ai.svc.cluster.local>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-08-12 14:55:17 +08:00
ad3fa4f49c
[Hotfix] README link ( #5966 )
...
* update ignore
* update readme
* run style
* update readme
2024-08-08 18:04:47 +08:00
0b2d55c4ab
Support overall loss, update KTO logging
2024-08-02 06:51:38 +00:00
1aeb5e8847
[hotfix] Remove unused plan section ( #5957 )
...
* remove readme
* fix readme
* update
2024-07-31 17:47:46 +08:00
66fbf2ecb7
Update README.md ( #5958 )
2024-07-31 17:44:09 +08:00
30f4e31a33
[Chat] Fix lora ( #5946 )
...
* fix merging
* remove filepath
* fix style
2024-07-31 14:10:17 +08:00
6fd9e86864
fix style
2024-07-29 01:29:18 +00:00
de1bf08ed0
fix style
2024-07-26 10:07:15 +00:00
8a3ff4f315
fix style
2024-07-26 09:55:15 +00:00
9688e19b32
remove real data path
2024-07-22 06:13:02 +00:00
b0e15d563e
remove real data path
2024-07-22 06:11:38 +00:00
12fe8b5858
refactor evaluation
2024-07-22 05:57:39 +00:00
c5f582f666
fix test data
2024-07-22 01:31:32 +00:00
150505cbb8
Merge branch 'kto' of https://github.com/hpcaitech/ColossalAI into kto
2024-07-19 10:11:05 +00:00
d49550fb49
refactor tokenization
2024-07-19 10:10:48 +00:00
d08c99be0d
Merge branch 'main' into kto
2024-07-19 15:23:31 +08:00
f585d4e38e
[ColossalChat] Hotfix for ColossalChat ( #5910 )
...
* add ignore and tiny llama
* fix path issue
* run style
* fix issue
* update bash
* add ignore and tiny llama
* fix path issue
* run style
* fix issue
* update bash
* fix ddp issue
* add Qwen 1.5 32B
2024-07-19 13:40:07 +08:00
544b7a38a1
fix style, add kto data sample
2024-07-18 08:38:56 +00:00
09d5ffca1a
add kto
2024-07-18 07:54:11 +00:00
b3594d4d68
fix orpo cross entropy loss
2024-07-15 02:12:05 +00:00
115c4cc5a4
hotfix citation
2024-07-11 06:05:05 +00:00
e7a8634636
fix eval
2024-07-11 03:35:03 +00:00
8a9721bafe
[pre-commit.ci] auto fixes from pre-commit.com hooks
...
for more information, see https://pre-commit.ci
2024-07-10 10:44:32 +00:00
f6ef5c3609
fix style
2024-07-10 10:37:17 +00:00
d888c3787c
add benchmark for sft, dpo, simpo, orpo. Add benchmarking result. Support lora with gradient checkpoint
2024-07-10 10:17:08 +00:00
16f3451fe2
Merge branch 'main' of https://github.com/hpcaitech/ColossalAI into rlhf_SimPO
2024-07-10 02:32:07 +00:00
7c2f79fa98
[pre-commit.ci] pre-commit autoupdate ( #5572 )
...
* [pre-commit.ci] pre-commit autoupdate
updates:
- [github.com/PyCQA/autoflake: v2.2.1 → v2.3.1](https://github.com/PyCQA/autoflake/compare/v2.2.1...v2.3.1 )
- [github.com/pycqa/isort: 5.12.0 → 5.13.2](https://github.com/pycqa/isort/compare/5.12.0...5.13.2 )
- [github.com/psf/black-pre-commit-mirror: 23.9.1 → 24.4.2](https://github.com/psf/black-pre-commit-mirror/compare/23.9.1...24.4.2 )
- [github.com/pre-commit/mirrors-clang-format: v13.0.1 → v18.1.7](https://github.com/pre-commit/mirrors-clang-format/compare/v13.0.1...v18.1.7 )
- [github.com/pre-commit/pre-commit-hooks: v4.3.0 → v4.6.0](https://github.com/pre-commit/pre-commit-hooks/compare/v4.3.0...v4.6.0 )
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
---------
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-07-01 17:16:41 +08:00
ff535204fe
update transformers version
2024-06-28 06:24:30 +00:00
a8af6ccb73
fix torch colossalai version
2024-06-28 03:58:29 +00:00
b117274074
fix colossalai, transformers version
2024-06-27 08:30:17 +00:00
afa53066ca
fix colossalai, transformers version
2024-06-27 08:28:36 +00:00
384c64057d
fix colossalai, transformers version
2024-06-27 08:26:44 +00:00
8aad064fe7
fix style
2024-06-27 07:29:33 +00:00
c8d1b4a968
add orpo
2024-06-27 07:20:28 +00:00
f3de5a025c
remove debug code
2024-06-24 05:16:29 +00:00
0b2d6275c4
fix dataloader
2024-06-24 05:10:44 +00:00
82aecd6374
add SimPO
2024-06-24 02:12:20 +00:00
84eab13078
update sft trainning script
2024-06-11 02:44:20 +00:00
2abdede1d7
fix readme
2024-06-10 01:08:42 +00:00
77db21610a
replace the customized dataloader setup with the build-in one
2024-06-07 09:44:25 +00:00
0d7ff10ea5
replace the customized dataloader setup with the build-in one
2024-06-07 09:43:42 +00:00
790e1362a6
merge
2024-06-07 07:01:32 +00:00
ac1520cb8f
remove baichuan from template test due to transformer version conflict
2024-06-07 07:01:32 +00:00
e16ccc272a
update ci
2024-06-07 07:01:32 +00:00
45195ac53d
remove local data path
2024-06-07 07:01:31 +00:00
bf57b13dda
remove models that require huggingface auth from ci
2024-06-07 07:01:31 +00:00
Tong Li