github
/
ColossalAI
mirror of https://github.com/hpcaitech/ColossalAI
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
3,619 Commits
40 Branches
49 Tags
234 MiB
Commit Graph

3619 Commits (3ab2f6fa329b6d12959fb3c668d278b4b225c5f0)

Author SHA1 Message Date
Tong Li 3ab2f6fa32 add eval 2024-08-19 07:53:01 +00:00
Tong Li fbcb0149bd Merge branch 'coati/add-pp' of github.com:TongLi3701/ColossalAI into coati/add-pp 2024-08-16 09:41:33 +00:00
Tong Li 42fcc16772 update no cache 2024-08-16 09:40:34 +00:00
pre-commit-ci[bot] b0c89bf298 [pre-commit.ci] auto fixes from pre-commit.com hooks 
for more information, see https://pre-commit.ci
 2024-08-15 05:53:50 +00:00
Tong Li 10b72a32b1 update ignore 2024-08-15 05:52:50 +00:00
Tong Li 4516a4ed6a update sft 2024-08-15 03:47:54 +00:00
Tong Li 4191f21f70 update all reduce 2024-08-15 03:46:43 +00:00
Tong Li e87cd8bcfb skip pp eval 2024-08-14 10:07:45 +00:00
Tong Li 409f4b5ab3 update 2024-08-14 07:19:34 +00:00
Tong Li b841ded016 Merge branch 'coati/support-pp' of github.com:TongLi3701/ColossalAI into coati/support-pp 2024-08-14 05:57:23 +00:00
pre-commit-ci[bot] 3629b36517 [pre-commit.ci] auto fixes from pre-commit.com hooks 
for more information, see https://pre-commit.ci
 2024-08-14 05:57:09 +00:00
Tong Li a8840a090f hotfix 2024-08-14 05:57:08 +00:00
Tong Li dd05dd0d83 add pp 2024-08-14 05:55:58 +00:00
Tong Li bf8e3a0e15 test 2024-08-14 05:55:58 +00:00
Tong Li 0247648844 fix eval 2024-08-14 05:55:58 +00:00
Tong Li fc5299c694 change to 4 2024-08-14 05:55:58 +00:00
Tong Li 9f31a261d9 fix 2024-08-14 05:55:58 +00:00
Tong Li 5e968b9e80 update test case 2024-08-14 05:55:58 +00:00
pre-commit-ci[bot] 0ed8efcaa0 [pre-commit.ci] auto fixes from pre-commit.com hooks 
for more information, see https://pre-commit.ci
 2024-08-14 05:55:58 +00:00
pre-commit-ci[bot] e6245485fc [pre-commit.ci] auto fixes from pre-commit.com hooks 
for more information, see https://pre-commit.ci
 2024-08-14 05:55:58 +00:00
Tong Li ba80449d62 refactor 2024-08-14 05:55:58 +00:00
pre-commit-ci[bot] f965ac8566 [pre-commit.ci] auto fixes from pre-commit.com hooks 
for more information, see https://pre-commit.ci
 2024-08-14 05:55:57 +00:00
Tong Li 5a24b0dc31 update rm 2024-08-14 05:55:57 +00:00
Tong Li 38c84a1aa0 support pp training 2024-08-14 05:55:57 +00:00
Tong Li ceb1e262e7
fix sync condition (#6000) 2024-08-14 11:22:39 +08:00
pre-commit-ci[bot] 2789c9ee6d [pre-commit.ci] auto fixes from pre-commit.com hooks 
for more information, see https://pre-commit.ci
 2024-08-13 09:36:23 +00:00
Tong Li 2422341d03 hotfix 2024-08-13 09:35:03 +00:00
Tong Li 22218d31e1 add pp 2024-08-13 07:53:10 +00:00
Tong Li 74ee10e77d test 2024-08-13 07:32:25 +00:00
Tong Li 0b2b454b97 fix eval 2024-08-13 06:48:54 +00:00
Tong Li 4a5bfc55a6 change to 4 2024-08-13 04:02:21 +00:00
Tong Li 8806efd047
Merge branch 'hpcaitech:main' into coati/support-pp 2024-08-13 11:59:53 +08:00
Tong Li 8ce504d05c fix 2024-08-13 02:47:52 +00:00
Tong Li a8356da3c7 update test case 2024-08-13 02:45:53 +00:00
pre-commit-ci[bot] 49f7428cbf [pre-commit.ci] auto fixes from pre-commit.com hooks 
for more information, see https://pre-commit.ci
 2024-08-12 11:36:43 +00:00
Tong Li 641867018f Merge branch 'coati/support-pp' of github.com:TongLi3701/ColossalAI into coati/support-pp 2024-08-12 11:35:40 +00:00
Tong Li 7d9907f0ae refactor 2024-08-12 11:35:14 +00:00
pre-commit-ci[bot] 2c926141f3 [pre-commit.ci] auto fixes from pre-commit.com hooks 
for more information, see https://pre-commit.ci
 2024-08-12 11:29:22 +00:00
Tong Li 56fd2dc5d2 Merge branch 'coati/support-pp' of github.com:TongLi3701/ColossalAI into coati/support-pp 2024-08-12 11:28:16 +00:00
Tong Li 123107ff28 update rm 2024-08-12 11:27:42 +00:00
pre-commit-ci[bot] 515f8e4a43 [pre-commit.ci] auto fixes from pre-commit.com hooks 
for more information, see https://pre-commit.ci
 2024-08-12 10:15:35 +00:00
Tong Li 4a541aa27c support pp training 2024-08-12 10:13:03 +00:00
YeAnbang ed97d3a5d3
[Chat] fix readme (#5989) 
* fix readme

* fix readme, tokenization fully tested

* fix readme, tokenization fully tested

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Co-authored-by: root <root@notebook-8f919155-6035-47b4-9c6f-1be133b9e2c9-0.notebook-8f919155-6035-47b4-9c6f-1be133b9e2c9.colossal-ai.svc.cluster.local>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2024-08-12 14:55:17 +08:00
Edenzzzz b4d2377d4c
[Hotfix] Avoid fused RMSnorm import error without apex (#5985) 
Co-authored-by: Edenzzzz <wtan45@wisc.edu>
 2024-08-09 18:17:09 +08:00
Tong Li ad3fa4f49c
[Hotfix] README link (#5966) 
* update ignore

* update readme

* run style

* update readme
 2024-08-08 18:04:47 +08:00
Edenzzzz 9179d4088e
[Docs] clarify launch port 
Co-authored-by: Edenzzzz <wtan45@wisc.edu>
 2024-08-07 13:53:48 +08:00
YeAnbang fe71917851
Merge pull request #5962 from hpcaitech/colossalchat 
[Chat] Support overall loss, update KTO logging
 2024-08-02 17:32:41 +08:00
YeAnbang 0b2d55c4ab Support overall loss, update KTO logging 2024-08-02 06:51:38 +00:00
Wang Binluo 75c963686f
[lora] lora support hybrid parallel plugin (#5956) 
* lora support hybrid plugin

* fix

* fix

* fix

* fix
 2024-08-02 10:36:58 +08:00
Tong Li 19d1510ea2
[feat] Dist Loader for Eval (#5950) 
* support auto distributed data loader

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* support auto distributed data loader

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix tp error

* remove unused parameters

* remove unused

* update inference

* update docs

* update inference

---------

Co-authored-by: Michelle <qianranma8@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2024-08-02 10:06:25 +08:00