github
/
ColossalAI
mirror of https://github.com/hpcaitech/ColossalAI
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
3,582 Commits
34 Branches
47 Tags
231 MiB
Commit Graph

58 Commits (f5c84af0b01bcd2e993d38dc628793f7f0a8ba64)

Author SHA1 Message Date
YeAnbang ed97d3a5d3
[Chat] fix readme (#5989) 
* fix readme

* fix readme, tokenization fully tested

* fix readme, tokenization fully tested

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Co-authored-by: root <root@notebook-8f919155-6035-47b4-9c6f-1be133b9e2c9-0.notebook-8f919155-6035-47b4-9c6f-1be133b9e2c9.colossal-ai.svc.cluster.local>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2024-08-12 14:55:17 +08:00
Tong Li ad3fa4f49c
[Hotfix] README link (#5966) 
* update ignore

* update readme

* run style

* update readme
 2024-08-08 18:04:47 +08:00
YeAnbang 0b2d55c4ab Support overall loss, update KTO logging 2024-08-02 06:51:38 +00:00
Tong Li 1aeb5e8847
[hotfix] Remove unused plan section (#5957) 
* remove readme

* fix readme

* update
 2024-07-31 17:47:46 +08:00
YeAnbang 66fbf2ecb7
Update README.md (#5958) 2024-07-31 17:44:09 +08:00
YeAnbang 30f4e31a33
[Chat] Fix lora (#5946) 
* fix merging

* remove filepath

* fix style
 2024-07-31 14:10:17 +08:00
YeAnbang 6fd9e86864 fix style 2024-07-29 01:29:18 +00:00
YeAnbang de1bf08ed0 fix style 2024-07-26 10:07:15 +00:00
YeAnbang 8a3ff4f315 fix style 2024-07-26 09:55:15 +00:00
YeAnbang 9688e19b32 remove real data path 2024-07-22 06:13:02 +00:00
YeAnbang b0e15d563e remove real data path 2024-07-22 06:11:38 +00:00
YeAnbang 12fe8b5858 refactor evaluation 2024-07-22 05:57:39 +00:00
YeAnbang c5f582f666 fix test data 2024-07-22 01:31:32 +00:00
YeAnbang 150505cbb8 Merge branch 'kto' of https://github.com/hpcaitech/ColossalAI into kto 2024-07-19 10:11:05 +00:00
YeAnbang d49550fb49 refactor tokenization 2024-07-19 10:10:48 +00:00
Tong Li d08c99be0d
Merge branch 'main' into kto 2024-07-19 15:23:31 +08:00
Tong Li f585d4e38e
[ColossalChat] Hotfix for ColossalChat (#5910) 
* add ignore and tiny llama

* fix path issue

* run style

* fix issue

* update bash

* add ignore and tiny llama

* fix path issue

* run style

* fix issue

* update bash

* fix ddp issue

* add Qwen 1.5 32B
 2024-07-19 13:40:07 +08:00
YeAnbang 544b7a38a1 fix style, add kto data sample 2024-07-18 08:38:56 +00:00
YeAnbang 09d5ffca1a add kto 2024-07-18 07:54:11 +00:00
YeAnbang b3594d4d68 fix orpo cross entropy loss 2024-07-15 02:12:05 +00:00
YeAnbang 115c4cc5a4 hotfix citation 2024-07-11 06:05:05 +00:00
YeAnbang e7a8634636 fix eval 2024-07-11 03:35:03 +00:00
pre-commit-ci[bot] 8a9721bafe [pre-commit.ci] auto fixes from pre-commit.com hooks 
for more information, see https://pre-commit.ci
 2024-07-10 10:44:32 +00:00
YeAnbang f6ef5c3609 fix style 2024-07-10 10:37:17 +00:00
YeAnbang d888c3787c add benchmark for sft, dpo, simpo, orpo. Add benchmarking result. Support lora with gradient checkpoint 2024-07-10 10:17:08 +00:00
YeAnbang 16f3451fe2 Merge branch 'main' of https://github.com/hpcaitech/ColossalAI into rlhf_SimPO 2024-07-10 02:32:07 +00:00
pre-commit-ci[bot] 7c2f79fa98
[pre-commit.ci] pre-commit autoupdate (#5572) 
* [pre-commit.ci] pre-commit autoupdate

updates:
- [github.com/PyCQA/autoflake: v2.2.1 → v2.3.1](https://github.com/PyCQA/autoflake/compare/v2.2.1...v2.3.1)
- [github.com/pycqa/isort: 5.12.0 → 5.13.2](https://github.com/pycqa/isort/compare/5.12.0...5.13.2)
- [github.com/psf/black-pre-commit-mirror: 23.9.1 → 24.4.2](https://github.com/psf/black-pre-commit-mirror/compare/23.9.1...24.4.2)
- [github.com/pre-commit/mirrors-clang-format: v13.0.1 → v18.1.7](https://github.com/pre-commit/mirrors-clang-format/compare/v13.0.1...v18.1.7)
- [github.com/pre-commit/pre-commit-hooks: v4.3.0 → v4.6.0](https://github.com/pre-commit/pre-commit-hooks/compare/v4.3.0...v4.6.0)

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2024-07-01 17:16:41 +08:00
YeAnbang ff535204fe update transformers version 2024-06-28 06:24:30 +00:00
YeAnbang a8af6ccb73 fix torch colossalai version 2024-06-28 03:58:29 +00:00
YeAnbang b117274074 fix colossalai, transformers version 2024-06-27 08:30:17 +00:00
YeAnbang afa53066ca fix colossalai, transformers version 2024-06-27 08:28:36 +00:00
YeAnbang 384c64057d fix colossalai, transformers version 2024-06-27 08:26:44 +00:00
YeAnbang 8aad064fe7 fix style 2024-06-27 07:29:33 +00:00
YeAnbang c8d1b4a968 add orpo 2024-06-27 07:20:28 +00:00
YeAnbang f3de5a025c remove debug code 2024-06-24 05:16:29 +00:00
YeAnbang 0b2d6275c4 fix dataloader 2024-06-24 05:10:44 +00:00
YeAnbang 82aecd6374 add SimPO 2024-06-24 02:12:20 +00:00
YeAnbang 84eab13078 update sft trainning script 2024-06-11 02:44:20 +00:00
YeAnbang 2abdede1d7 fix readme 2024-06-10 01:08:42 +00:00
YeAnbang 77db21610a replace the customized dataloader setup with the build-in one 2024-06-07 09:44:25 +00:00
YeAnbang 0d7ff10ea5 replace the customized dataloader setup with the build-in one 2024-06-07 09:43:42 +00:00
YeAnbang 790e1362a6 merge 2024-06-07 07:01:32 +00:00
YeAnbang ac1520cb8f remove baichuan from template test due to transformer version conflict 2024-06-07 07:01:32 +00:00
YeAnbang e16ccc272a update ci 2024-06-07 07:01:32 +00:00
YeAnbang 45195ac53d remove local data path 2024-06-07 07:01:31 +00:00
YeAnbang bf57b13dda remove models that require huggingface auth from ci 2024-06-07 07:01:31 +00:00
YeAnbang 0bbac158ed fix datasets version 2024-06-07 07:01:31 +00:00
YeAnbang 62eb28b929 remove duplicated test 2024-06-07 07:01:31 +00:00
YeAnbang b8b5cacf38 fix transformers version 2024-06-07 07:01:31 +00:00
pre-commit-ci[bot] 1b880ce095 [pre-commit.ci] auto fixes from pre-commit.com hooks 
for more information, see https://pre-commit.ci
 2024-06-07 07:01:31 +00:00