github
/
ColossalAI
mirror of https://github.com/hpcaitech/ColossalAI
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
2,382 Commits
32 Branches
46 Tags
228 MiB
Commit Graph

2382 Commits (5f79008c4a7a0e854f53d7f1c0b29ca7f411eeab)

Author SHA1 Message Date
ramos 2ef855c798
support shardinit option to avoid OPT OOM initializing problem (#3037) 
Co-authored-by: poe <poe@nemoramo>
 2023-03-08 13:45:15 +08:00
YuliangLiu0306 29386a54e6
[DTensor] refactor CommSpec (#3034) 2023-03-08 10:45:31 +08:00
Frank Lee ea0b52c12e
[doc] specified operating system requirement (#3019) 
* [doc] specified operating system requirement

* polish code
 2023-03-07 18:04:10 +08:00
ver217 378d827c6b
[doc] update nvme offload doc (#3014) 
* [doc] update nvme offload doc

* [doc] add doc testing cmd and requirements

* [doc] add api reference

* [doc] add dependencies
 2023-03-07 17:49:01 +08:00
Fazzie-Maqianli c21b11edce
change nn to models (#3032) 2023-03-07 16:34:22 +08:00
YuliangLiu0306 4269196c79
[hotfix] skip auto checkpointing tests (#3029) 
* [hotfix] skip auto checkpointing tests

* fix test name issue
 2023-03-07 15:50:00 +08:00
Frank Lee 8fedc8766a
[workflow] supported conda package installation in doc test (#3028) 
* [workflow] supported conda package installation in doc test

* polish code

* polish code

* polish code

* polish code

* polish code

* polish code
 2023-03-07 14:21:26 +08:00
Frank Lee 2cd6ba3098
[workflow] fixed the post-commit failure when no formatting needed (#3020) 
* [workflow] fixed the post-commit failure when no formatting needed

* polish code

* polish code

* polish code
 2023-03-07 13:35:45 +08:00
Frank Lee 2e427ddf42
[revert] recover "[refactor] restructure configuration files (#2977)" (#3022) 
This reverts commit 35c8f4ce47.
 2023-03-07 13:31:23 +08:00
github-actions[bot] e86d9bb2e1
[format] applied code formatting on changed files in pull request 3025 (#3026) 
Co-authored-by: github-actions <github-actions@github.com>
 2023-03-07 12:55:17 +08:00
YuliangLiu0306 cd2b0eaa8d
[DTensor] refactor sharding spec (#2987) 
* [autoparallel] refactor sharding spec

* rename function name
 2023-03-07 11:08:11 +08:00
Ziyue Jiang 400f63012e
[pipeline] Add Simplified Alpa DP Partition (#2507) 
* add alpa dp split

* add alpa dp split

* use fwd+bwd instead of fwd only

---------

Co-authored-by: Ziyue Jiang <ziyue.jiang@gmail.com>
 2023-03-07 10:34:31 +08:00
Super Daniel b42d3d28ed
[fx] remove depreciated algorithms. (#2312) (#2313) 2023-03-07 10:30:35 +08:00
BlueRum 55dcd3051a
[chatgpt] fix readme (#3025) 2023-03-07 10:21:25 +08:00
LuGY 287d60499e
[chatgpt] Add saving ckpt callback for PPO (#2880) 
* add checkpoint callback for chatgpt

* add save ckpt callbacks for ppo

---------

Co-authored-by: Fazzie-Maqianli <55798671+Fazziekey@users.noreply.github.com>
 2023-03-07 10:13:25 +08:00
BlueRum e588703454
[chatgpt]fix inference model load (#2988) 
* fix lora bug

* polish

* fix lora gemini

* fix inference laod model bug
 2023-03-07 09:17:52 +08:00
github-actions[bot] 82503a96f2
[format] applied code formatting on changed files in pull request 2997 (#3008) 
Co-authored-by: github-actions <github-actions@github.com>
 2023-03-06 10:42:22 +08:00
binmakeswell 52a5078988
[doc] add ISC tutorial (#2997) 
* [doc] add ISC tutorial

* [doc] add ISC tutorial

* [doc] add ISC tutorial

* [doc] add ISC tutorial
 2023-03-06 10:36:38 +08:00
Saurav Maheshkar 35c8f4ce47
[refactor] restructure configuration files (#2977) 
* gh: move CONTRIBUTING to .github

* chore: move isort config to pyproject

* chore: move pytest config to pyproject

* chore: move yapf config to pyproject

* chore: move clang-format config to pre-commit
 2023-03-05 20:29:34 +08:00
ver217 823f3b9cf4
[doc] add deepspeed citation and copyright (#2996) 
* [doc] add deepspeed citation and copyright

* [doc] add deepspeed citation and copyright

* [doc] add deepspeed citation and copyright
 2023-03-04 20:08:11 +08:00
Frank Lee e0a1c1321c
[doc] added reference to related works (#2994) 
* [doc] added reference to related works

* polish code
 2023-03-04 17:32:22 +08:00
Yasyf Mohamedali 19fa0e57f6
Remove extraneous comma (#2993) 
Prevents `TypeError: category must be a Warning subclass, not 'str'`.
 2023-03-04 14:44:06 +08:00
Frank Lee 3a5d93bc2c
[kernel] cached the op kernel and fixed version check (#2886) 
* [kernel] cached the op kernel and fixed version check

* polish code

* polish code
 2023-03-03 21:45:05 +08:00
ver217 0ff8406b00
[chatgpt] allow shard init and display warning (#2986) 2023-03-03 16:27:59 +08:00
BlueRum f5ca0397dd
[chatgpt] fix lora gemini conflict in RM training (#2984) 
* fix lora bug

* polish

* fix lora gemini
 2023-03-03 15:58:16 +08:00
ver217 19ad49fb3b
[chatgpt] making experience support dp (#2971) 
* [chatgpt] making experience support dp

* [chatgpt] update example test ci

* [chatgpt] update example test ci

* [chatgpt] update example test ci

* [chatgpt] update example test ci

* [chatgpt] update sampler

* [chatgpt] update example test ci

* [chatgpt] refactor sampler

* [chatgpt] update example test ci
 2023-03-03 15:51:19 +08:00
github-actions[bot] 827a0af8cc
Automated submodule synchronization (#2982) 
Co-authored-by: github-actions <github-actions@github.com>
 2023-03-03 10:55:45 +08:00
binmakeswell 9b4ceefc21
[doc] update news (#2983) 
* [doc] update news

* [doc] update news
 2023-03-03 10:41:58 +08:00
BlueRum c9e27f0d1b
[chatgpt]fix lora bug (#2974) 
* fix lora bug

* polish
 2023-03-02 17:51:44 +08:00
BlueRum 82149e9d1b
[chatgpt] fix inference demo loading bug (#2969) 
* [chatgpt] fix inference demo loading bug

* polish
 2023-03-02 16:18:33 +08:00
Fazzie-Maqianli bbf9c827c3
[ChatGPT] fix README (#2966) 
* Update README.md

* fix README

* Update README.md

* Update README.md

---------

Co-authored-by: fastalgo <youyang@cs.berkeley.edu>
Co-authored-by: BlueRum <70618399+ht-zhou@users.noreply.github.com>
 2023-03-02 15:00:05 +08:00
binmakeswell b0a8766381
[doc] fix chatgpt inference typo (#2964) 2023-03-02 11:22:08 +08:00
github-actions[bot] 0d07514988
Automated submodule synchronization (#2951) 
Co-authored-by: github-actions <github-actions@github.com>
 2023-03-02 09:15:21 +08:00
YuliangLiu0306 e414e4092b
[DTensor] implementation of dtensor (#2946) 
* [DTensor] implementation of dtensor

* test layout convert

* polish
 2023-03-01 16:34:58 +08:00
BlueRum 489a9566af
[chatgpt]add inference example (#2944) 
* [chatgpt] support inference example

* Create inference.sh

* Update README.md

* Delete inference.sh

* Update inference.py
 2023-03-01 13:39:39 +08:00
YuliangLiu0306 47fb214b3b
[hotfix] add shard dim to aviod backward communication error (#2954) 2023-03-01 11:41:53 +08:00
ver217 090f14fd6b
[misc] add reference (#2930) 
* [misc] add reference

* [misc] add license
 2023-02-28 18:07:24 +08:00
github-actions[bot] dca98937f8
[format] applied code formatting on changed files in pull request 2933 (#2939) 
Co-authored-by: github-actions <github-actions@github.com>
 2023-02-28 15:41:52 +08:00
binmakeswell 8264cd7ef1
[doc] add env scope (#2933) 2023-02-28 15:39:51 +08:00
Frank Lee b8804aa60c
[doc] added readme for documentation (#2935) 2023-02-28 14:04:52 +08:00
Frank Lee 9e3b8b7aff
[doc] removed read-the-docs (#2932) 2023-02-28 11:28:24 +08:00
Frank Lee 77b88a3849
[workflow] added auto doc test on PR (#2929) 
* [workflow] added auto doc test on PR

* [workflow] added doc test workflow

* polish code

* polish code

* polish code

* polish code

* polish code

* polish code

* polish code
 2023-02-28 11:10:38 +08:00
YuliangLiu0306 197d0bf4ed
[autoparallel] apply repeat block to reduce solving time (#2912) 2023-02-28 11:03:30 +08:00
YH a848091141
Fix port exception type (#2925) 2023-02-28 11:00:43 +08:00
zbian 61e687831d fixed using zero with tp cannot access weight correctly 2023-02-28 10:52:30 +08:00
github-actions[bot] eb5cf94332
Automated submodule synchronization (#2927) 
Co-authored-by: github-actions <github-actions@github.com>
 2023-02-28 10:35:23 +08:00
github-actions[bot] da056285f2
[format] applied code formatting on changed files in pull request 2922 (#2923) 
Co-authored-by: github-actions <github-actions@github.com>
 2023-02-27 19:29:06 +08:00
binmakeswell 12bafe057f
[doc] update installation for GPT (#2922) 2023-02-27 18:28:34 +08:00
binmakeswell 0afb55fc5b
[doc] add os scope, update tutorial install and tips (#2914) 2023-02-27 14:59:27 +08:00
YH 7b13f7db18
[zero] trivial zero optimizer refactoring (#2869) 
* Fix mionr grad store interface

* Apply lint
 2023-02-27 14:04:53 +08:00