github
/
ColossalAI
mirror of https://github.com/hpcaitech/ColossalAI
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
2,221 Commits
32 Branches
46 Tags
228 MiB
Commit Graph

2221 Commits (573af8418406a319e91be07f58fca798a6e72dbd)

Author SHA1 Message Date
YuliangLiu0306 ecd643f1e4
[test] add torchrec models to test model zoo (#3139) 2023-03-15 05:46:04 +00:00
ver217 14a115000b
[tests] model zoo add torchaudio models (#3138) 
* [tests] model zoo add torchaudio models

* [tests] refactor torchaudio wavernn

* [tests] refactor fx torchaudio tests
 2023-03-15 11:51:16 +08:00
Frank Lee 6d48eb0560
[test] added transformers models to test model zoo (#3135) 2023-03-15 11:26:10 +08:00
Frank Lee a674c63348
[test] added torchvision models to test model zoo (#3132) 
* [test] added torchvision models to test model zoo

* polish code

* polish code

* polish code

* polish code

* polish code

* polish code
 2023-03-15 10:42:07 +08:00
HELSON 1216d1e7bd
[tests] diffuser models in model zoo (#3136) 
* [tests] diffuser models in model zoo

* remove useless code

* [tests] add diffusers to requirement-test
 2023-03-14 17:20:28 +08:00
Saurav Maheshkar 1a46e71e07
[docker] Add opencontainers image-spec to `Dockerfile` (#3006) 
* feat(docker): Add opencontainers image-spec to `Dockerfile`

This PR makes few changes to improve the overall quality of the docker image 🐳 . For reference more annotations can be found [here](https://github.com/opencontainers/image-spec/blob/main/annotations.md)

* feat(docker): add inline version declaration

* fix(docker): drop `org.opencontainers.image.version` LABEL
 2023-03-14 16:28:06 +08:00
YuliangLiu0306 2eca4cd376
[DTensor] refactor dtensor with new components (#3089) 
* [DTensor] refactor dtensor with new components

* polish
 2023-03-14 16:25:47 +08:00
ver217 ed8f60b93b
[lazyinit] refactor lazy tensor and lazy init ctx (#3131) 
* [lazyinit] refactor lazy tensor and lazy init ctx

* [lazyinit] polish docstr

* [lazyinit] polish docstr
 2023-03-14 15:37:12 +08:00
Frank Lee 86ac782d7c
[test] added timm models to test model zoo (#3129) 
* [test] added timm models to test model zoo

* polish code

* polish code

* polish code

* polish code

* polish code
 2023-03-14 14:29:18 +08:00
BlueRum 23cd5e2ccf
[chatgpt]update ci (#3087) 
* [chatgpt]update ci

* Update test_ci.sh

* Update test_ci.sh

* Update test_ci.sh

* test

* Update train_prompts.py

* Update train_dummy.py

* add save_path

* polish

* add save path

* polish

* add save path

* polish

* delete bloom-560m test

delete bloom-560m test because of oom

* add ddp test
 2023-03-14 11:01:17 +08:00
Frank Lee 169ed4d24e
[workflow] purged extension cache before GPT test (#3128) 2023-03-14 10:11:32 +08:00
Xuanlei Zhao 30dd13c450
[autochunk] support complete benchmark (#3121) 
* refact memory code

* dont log free var memory

* add memory align

* update chunk target

* update setting for new memory

* finish test

* update tracer

* update typo

* update test

* add unet test

* add bench

* update bench

* update bench

* init

* support vit

* move to cpu

* add cpu benchmark
 2023-03-13 17:42:37 +08:00
BlueRum 68577fbc43
[chatgpt]Fix examples (#3116) 
* fix train_dummy

* fix train-prompts
 2023-03-13 11:12:22 +08:00
BlueRum 0672b5afac
[chatgpt] fix lora support for gpt (#3113) 
* fix gpt-actor

* fix gpt-critic

* fix opt-critic
 2023-03-13 10:37:41 +08:00
github-actions[bot] 0aa92c0409
Automated submodule synchronization (#3105) 
Co-authored-by: github-actions <github-actions@github.com>
 2023-03-13 08:58:06 +08:00
Jeff Rasley 453f7ae5a0
prevent op_builder being installed in site-pkgs (#3104) 2023-03-13 08:50:31 +08:00
hiko2MSP 191daf7411
[chatgpt] type miss of kwargs (#3107) 2023-03-13 00:00:02 +08:00
binmakeswell 145ccfd7d1
[doc] add Intel cooperation for biomedicine (#3108) 
* [doc] add Intel cooperation for biomedicine
 2023-03-11 15:21:45 +08:00
BlueRum c9dd036592
[chatgpt] fix lora save bug (#3099) 
* fix colo-stratergy

* polish

* fix lora

* fix ddp

* polish

* polish
 2023-03-10 17:58:10 +08:00
binmakeswell 018936a3f3
[tutorial] update notes for TransformerEngine (#3098) 2023-03-10 16:30:52 +08:00
Kirthi Shankar Sivamani 65a4dbda6c
[NVIDIA] Add FP8 example using TE (#3080) 
Signed-off-by: Kirthi Shankar Sivamani <ksivamani@nvidia.com>
 2023-03-10 16:24:08 +08:00
Frank Lee 26db1cb57b
[release] v0.2.7 (#3094) 2023-03-10 14:54:37 +08:00
Fazzie-Maqianli 02ae80bf9c
[chatgpt]add flag of action mask in critic(#3086) 2023-03-10 14:40:14 +08:00
Frank Lee 95a36eae63
[kernel] added kernel loader to softmax autograd function (#3093) 
* [kernel] added kernel loader to softmax autograd function

* [release] v0.2.6
 2023-03-10 14:27:09 +08:00
Super Daniel fff98f06ed
[analyzer] a minimal implementation of static graph analyzer (#2852) 
* [hotfix] meta tensor default device.

* [siu] add experimental submodules to main branch.

* [siu]

* [siu]

* [analyzer] init.

* [analyzer] readme.

* [analyzer] readme.

* [analyzer] readme.

* [analyzer] readme.

* [test] add test.

* Update symbolic_trace.py

* mark skip tests.

* try except.

* try except.

* try except.

* s

* init

* init

* fix

* skip

* skip

---------

Co-authored-by: Daniel Shao <superdainiu@MININT-PVARVID.fareast.corp.microsoft.com>
Co-authored-by: Daniel Shao <superdainiu@Daniels-Mac.local>
 2023-03-10 13:21:05 +08:00
Fazzie-Maqianli 5d5f475d75
[diffusers] fix ci and docker (#3085) 2023-03-10 10:35:15 +08:00
Frank Lee 3213347b49
[doc] fixed typos in docs/README.md (#3082) 2023-03-10 10:32:14 +08:00
Xuanlei Zhao 10c61de2f7
[autochunk] support vit (#3084) 
support vit for autochunk
* support some new ops for vit
* fix some bugs
* add test for vit
 2023-03-10 10:23:26 +08:00
Camille Zhong e58a3c804c
Fix the version of lightning and colossalai in Stable Diffusion environment requirement (#3073) 
1. Modify the README of stable diffusion
2. Fix the version of pytorch lightning&lightning and colossalai version to enable codes running successfully.
 2023-03-10 09:55:58 +08:00
YuliangLiu0306 8e4e8601b7
[DTensor] implement layout converter (#3055) 
* [DTensor] refactor LayoutConverter for DTensor

* polish code

* polish docstring
 2023-03-10 09:53:52 +08:00
Frank Lee 89aa7926ac
[release] v0.2.6 (#3057) 2023-03-10 09:47:20 +08:00
Frank Lee 416a50dbd7
[doc] moved doc test command to bottom (#3075) 2023-03-09 18:10:45 +08:00
Frank Lee 91ccf97514
[workflow] fixed doc build trigger condition (#3072) 2023-03-09 17:31:41 +08:00
Frank Lee f19b49e164
[booster] init module structure and definition (#3056) 2023-03-09 11:27:46 +08:00
github-actions[bot] faa8526b85
Automated submodule synchronization (#3062) 
Co-authored-by: github-actions <github-actions@github.com>
 2023-03-09 11:22:56 +08:00
binmakeswell 360674283d
[example] fix redundant note (#3065) 2023-03-09 10:59:28 +08:00
Tomek af3888481d
[example] fixed opt model downloading from huggingface 2023-03-09 10:47:41 +08:00
Xuanlei Zhao 2ca9728cbb
[autochunk] refactor chunk memory estimation (#2762) 
* refact memory code

* dont log free var memory

* add memory align

* update chunk target

* update setting for new memory

* finish test

* update tracer

* update typo

* update test
 2023-03-08 16:22:30 +08:00
wenjunyang b51bfec357
[chatgpt] change critic input as state (#3042) 
* fix Critic

* fix Critic

* fix Critic

* fix neglect of attention mask

* fix neglect of attention mask

* fix neglect of attention mask

* add return

---------

Co-authored-by: yangwenjun <yangwenjun@soyoung.com>
Co-authored-by: yangwjd <yangwjd@chanjet.com>
 2023-03-08 15:18:02 +08:00
ramos 2ef855c798
support shardinit option to avoid OPT OOM initializing problem (#3037) 
Co-authored-by: poe <poe@nemoramo>
 2023-03-08 13:45:15 +08:00
YuliangLiu0306 29386a54e6
[DTensor] refactor CommSpec (#3034) 2023-03-08 10:45:31 +08:00
Frank Lee ea0b52c12e
[doc] specified operating system requirement (#3019) 
* [doc] specified operating system requirement

* polish code
 2023-03-07 18:04:10 +08:00
ver217 378d827c6b
[doc] update nvme offload doc (#3014) 
* [doc] update nvme offload doc

* [doc] add doc testing cmd and requirements

* [doc] add api reference

* [doc] add dependencies
 2023-03-07 17:49:01 +08:00
Fazzie-Maqianli c21b11edce
change nn to models (#3032) 2023-03-07 16:34:22 +08:00
YuliangLiu0306 4269196c79
[hotfix] skip auto checkpointing tests (#3029) 
* [hotfix] skip auto checkpointing tests

* fix test name issue
 2023-03-07 15:50:00 +08:00
Frank Lee 8fedc8766a
[workflow] supported conda package installation in doc test (#3028) 
* [workflow] supported conda package installation in doc test

* polish code

* polish code

* polish code

* polish code

* polish code

* polish code
 2023-03-07 14:21:26 +08:00
Frank Lee 2cd6ba3098
[workflow] fixed the post-commit failure when no formatting needed (#3020) 
* [workflow] fixed the post-commit failure when no formatting needed

* polish code

* polish code

* polish code
 2023-03-07 13:35:45 +08:00
Frank Lee 2e427ddf42
[revert] recover "[refactor] restructure configuration files (#2977)" (#3022) 
This reverts commit 35c8f4ce47.
 2023-03-07 13:31:23 +08:00
github-actions[bot] e86d9bb2e1
[format] applied code formatting on changed files in pull request 3025 (#3026) 
Co-authored-by: github-actions <github-actions@github.com>
 2023-03-07 12:55:17 +08:00
YuliangLiu0306 cd2b0eaa8d
[DTensor] refactor sharding spec (#2987) 
* [autoparallel] refactor sharding spec

* rename function name
 2023-03-07 11:08:11 +08:00