YeAnbang
6fd9e86864
fix style
2024-07-29 01:29:18 +00:00
YeAnbang
de1bf08ed0
fix style
2024-07-26 10:07:15 +00:00
YeAnbang
8a3ff4f315
fix style
2024-07-26 09:55:15 +00:00
YeAnbang
9688e19b32
remove real data path
2024-07-22 06:13:02 +00:00
YeAnbang
b0e15d563e
remove real data path
2024-07-22 06:11:38 +00:00
YeAnbang
12fe8b5858
refactor evaluation
2024-07-22 05:57:39 +00:00
YeAnbang
c5f582f666
fix test data
2024-07-22 01:31:32 +00:00
YeAnbang
150505cbb8
Merge branch 'kto' of https://github.com/hpcaitech/ColossalAI into kto
2024-07-19 10:11:05 +00:00
YeAnbang
d49550fb49
refactor tokenization
2024-07-19 10:10:48 +00:00
Tong Li
d08c99be0d
Merge branch 'main' into kto
2024-07-19 15:23:31 +08:00
Tong Li
f585d4e38e
[ColossalChat] Hotfix for ColossalChat ( #5910 )
...
* add ignore and tiny llama
* fix path issue
* run style
* fix issue
* update bash
* add ignore and tiny llama
* fix path issue
* run style
* fix issue
* update bash
* fix ddp issue
* add Qwen 1.5 32B
2024-07-19 13:40:07 +08:00
YeAnbang
544b7a38a1
fix style, add kto data sample
2024-07-18 08:38:56 +00:00
YeAnbang
09d5ffca1a
add kto
2024-07-18 07:54:11 +00:00
YeAnbang
b3594d4d68
fix orpo cross entropy loss
2024-07-15 02:12:05 +00:00
YeAnbang
115c4cc5a4
hotfix citation
2024-07-11 06:05:05 +00:00
YeAnbang
e7a8634636
fix eval
2024-07-11 03:35:03 +00:00
pre-commit-ci[bot]
8a9721bafe
[pre-commit.ci] auto fixes from pre-commit.com hooks
...
for more information, see https://pre-commit.ci
2024-07-10 10:44:32 +00:00
YeAnbang
f6ef5c3609
fix style
2024-07-10 10:37:17 +00:00
YeAnbang
d888c3787c
add benchmark for sft, dpo, simpo, orpo. Add benchmarking result. Support lora with gradient checkpoint
2024-07-10 10:17:08 +00:00
YeAnbang
16f3451fe2
Merge branch 'main' of https://github.com/hpcaitech/ColossalAI into rlhf_SimPO
2024-07-10 02:32:07 +00:00
pre-commit-ci[bot]
7c2f79fa98
[pre-commit.ci] pre-commit autoupdate ( #5572 )
...
* [pre-commit.ci] pre-commit autoupdate
updates:
- [github.com/PyCQA/autoflake: v2.2.1 → v2.3.1](https://github.com/PyCQA/autoflake/compare/v2.2.1...v2.3.1 )
- [github.com/pycqa/isort: 5.12.0 → 5.13.2](https://github.com/pycqa/isort/compare/5.12.0...5.13.2 )
- [github.com/psf/black-pre-commit-mirror: 23.9.1 → 24.4.2](https://github.com/psf/black-pre-commit-mirror/compare/23.9.1...24.4.2 )
- [github.com/pre-commit/mirrors-clang-format: v13.0.1 → v18.1.7](https://github.com/pre-commit/mirrors-clang-format/compare/v13.0.1...v18.1.7 )
- [github.com/pre-commit/pre-commit-hooks: v4.3.0 → v4.6.0](https://github.com/pre-commit/pre-commit-hooks/compare/v4.3.0...v4.6.0 )
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
---------
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-07-01 17:16:41 +08:00
YeAnbang
ff535204fe
update transformers version
2024-06-28 06:24:30 +00:00
YeAnbang
a8af6ccb73
fix torch colossalai version
2024-06-28 03:58:29 +00:00
YeAnbang
b117274074
fix colossalai, transformers version
2024-06-27 08:30:17 +00:00
YeAnbang
afa53066ca
fix colossalai, transformers version
2024-06-27 08:28:36 +00:00
YeAnbang
384c64057d
fix colossalai, transformers version
2024-06-27 08:26:44 +00:00
YeAnbang
8aad064fe7
fix style
2024-06-27 07:29:33 +00:00
YeAnbang
c8d1b4a968
add orpo
2024-06-27 07:20:28 +00:00
YeAnbang
f3de5a025c
remove debug code
2024-06-24 05:16:29 +00:00
YeAnbang
0b2d6275c4
fix dataloader
2024-06-24 05:10:44 +00:00
YeAnbang
82aecd6374
add SimPO
2024-06-24 02:12:20 +00:00
YeAnbang
84eab13078
update sft trainning script
2024-06-11 02:44:20 +00:00
YeAnbang
2abdede1d7
fix readme
2024-06-10 01:08:42 +00:00
YeAnbang
77db21610a
replace the customized dataloader setup with the build-in one
2024-06-07 09:44:25 +00:00
YeAnbang
0d7ff10ea5
replace the customized dataloader setup with the build-in one
2024-06-07 09:43:42 +00:00
YeAnbang
790e1362a6
merge
2024-06-07 07:01:32 +00:00
YeAnbang
ac1520cb8f
remove baichuan from template test due to transformer version conflict
2024-06-07 07:01:32 +00:00
YeAnbang
e16ccc272a
update ci
2024-06-07 07:01:32 +00:00
YeAnbang
45195ac53d
remove local data path
2024-06-07 07:01:31 +00:00
YeAnbang
bf57b13dda
remove models that require huggingface auth from ci
2024-06-07 07:01:31 +00:00
YeAnbang
0bbac158ed
fix datasets version
2024-06-07 07:01:31 +00:00
YeAnbang
62eb28b929
remove duplicated test
2024-06-07 07:01:31 +00:00
YeAnbang
b8b5cacf38
fix transformers version
2024-06-07 07:01:31 +00:00
pre-commit-ci[bot]
1b880ce095
[pre-commit.ci] auto fixes from pre-commit.com hooks
...
for more information, see https://pre-commit.ci
2024-06-07 07:01:31 +00:00
YeAnbang
7ae87b3159
fix training script
2024-06-07 07:01:31 +00:00
YeAnbang
0b4a33548c
moupdate ci tests, st ci test cases passed, tp failed in generation for ppo, sp is buggy
2024-06-07 07:01:31 +00:00
YeAnbang
7e65b71815
run pre-commit
2024-06-07 07:01:30 +00:00
YeAnbang
929e1e3da4
upgrade ppo dpo rm script
2024-06-07 07:01:30 +00:00
YeAnbang
7a7e86987d
upgrade colossal-chat support tp_group>1, add sp for sft
2024-06-07 07:01:30 +00:00
Hongxin Liu
7f8b16635b
[misc] refactor launch API and tensor constructor ( #5666 )
...
* [misc] remove config arg from initialize
* [misc] remove old tensor contrusctor
* [plugin] add npu support for ddp
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* [devops] fix doc test ci
* [test] fix test launch
* [doc] update launch doc
---------
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-04-29 10:40:11 +08:00