Maruyama_Aya
d3379f0be7
fixed model saving bugs
2 years ago
Maruyama_Aya
b29e1f0722
change directory
2 years ago
Maruyama_Aya
1c1f71cbd2
fixing insecure hash function
2 years ago
Maruyama_Aya
b56c7f4283
update shell file
2 years ago
Maruyama_Aya
176010f289
update performance evaluation
2 years ago
Maruyama_Aya
25447d4407
modify path
2 years ago
Maruyama_Aya
60ec33bb18
Add a new example of Dreambooth training using the booster API
2 years ago
jiangmingyan
5f79008c4a
[example] update gemini examples ( #3868 )
...
* [example]update gemini examples
* [example]update gemini examples
2 years ago
digger yu
518b31c059
[docs] change placememt_policy to placement_policy ( #3829 )
...
* fix typo colossalai/autochunk auto_parallel amp
* fix typo colossalai/auto_parallel nn utils etc.
* fix typo colossalai/auto_parallel autochunk fx/passes etc.
* fix typo docs/
* change placememt_policy to placement_policy in docs/ and examples/
2 years ago
github-actions[bot]
62c7e67f9f
[format] applied code formatting on changed files in pull request 3786 ( #3787 )
...
Co-authored-by: github-actions <github-actions@github.com>
2 years ago
binmakeswell
ad2cf58f50
[chat] add performance and tutorial ( #3786 )
2 years ago
binmakeswell
15024e40d9
[auto] fix install cmd ( #3772 )
2 years ago
digger-yu
b7141c36dd
[CI] fix some spelling errors ( #3707 )
...
* fix spelling error with examples/comminity/
* fix spelling error with tests/
* fix some spelling error with tests/ colossalai/ etc.
2 years ago
Hongxin Liu
3bf09efe74
[booster] update prepare dataloader method for plugin ( #3706 )
...
* [booster] add prepare dataloader method for plug
* [booster] update examples and docstr
2 years ago
Hongxin Liu
f83ea813f5
[example] add train resnet/vit with booster example ( #3694 )
...
* [example] add train vit with booster example
* [example] update readme
* [example] add train resnet with booster example
* [example] enable ci
* [example] enable ci
* [example] add requirements
* [hotfix] fix analyzer init
* [example] update requirements
2 years ago
Hongxin Liu
d556648885
[example] add finetune bert with booster example ( #3693 )
2 years ago
digger-yu
b9a8dff7e5
[doc] Fix typo under colossalai and doc( #3618 )
...
* Fixed several spelling errors under colossalai
* Fix the spelling error in colossalai and docs directory
* Cautious Changed the spelling error under the example folder
* Update runtime_preparation_pass.py
revert autograft to autograd
* Update search_chunk.py
utile to until
* Update check_installation.py
change misteach to mismatch in line 91
* Update 1D_tensor_parallel.md
revert to perceptron
* Update 2D_tensor_parallel.md
revert to perceptron in line 73
* Update 2p5D_tensor_parallel.md
revert to perceptron in line 71
* Update 3D_tensor_parallel.md
revert to perceptron in line 80
* Update README.md
revert to resnet in line 42
* Update reorder_graph.py
revert to indice in line 7
* Update p2p.py
revert to megatron in line 94
* Update initialize.py
revert to torchrun in line 198
* Update routers.py
change to detailed in line 63
* Update routers.py
change to detailed in line 146
* Update README.md
revert random number in line 402
2 years ago
github-actions[bot]
d544ed4345
[bot] Automated submodule synchronization ( #3596 )
...
Co-authored-by: github-actions <github-actions@github.com>
2 years ago
digger-yu
d0fbd4b86f
[example] fix community doc ( #3586 )
...
Adjusted the style of Community Examples to be consistent with other titles
2 years ago
binmakeswell
f1b3d60cae
[example] reorganize for community examples ( #3557 )
2 years ago
natalie_cao
de84c0311a
Polish Code
2 years ago
binmakeswell
0c0455700f
[doc] add requirement and highlight application ( #3516 )
...
* [doc] add requirement and highlight application
* [doc] link example and application
2 years ago
mandoxzhang
8f2c55f9c9
[example] remove redundant texts & update roberta ( #3493 )
...
* update roberta example
* update roberta example
* modify conflict & update roberta
2 years ago
mandoxzhang
ab5fd127e3
[example] update roberta with newer ColossalAI ( #3472 )
...
* update roberta example
* update roberta example
2 years ago
NatalieC323
fb8fae6f29
Revert "[dreambooth] fixing the incompatibity in requirements.txt ( #3190 ) ( #3378 )" ( #3481 )
2 years ago
NatalieC323
c701b77b11
[dreambooth] fixing the incompatibity in requirements.txt ( #3190 ) ( #3378 )
...
* Update requirements.txt
* Update environment.yaml
* Update README.md
* Update environment.yaml
* Update README.md
* Update README.md
* Delete requirements_colossalai.txt
* Update requirements.txt
* Update README.md
2 years ago
Frank Lee
80eba05b0a
[test] refactor tests with spawn ( #3452 )
...
* [test] added spawn decorator
* polish code
* polish code
* polish code
* polish code
* polish code
* polish code
2 years ago
Frank Lee
7d8d825681
[booster] fixed the torch ddp plugin with the new checkpoint api ( #3442 )
2 years ago
ver217
573af84184
[example] update examples related to zero/gemini ( #3431 )
...
* [zero] update legacy import
* [zero] update examples
* [example] fix opt tutorial
* [example] fix opt tutorial
* [example] fix opt tutorial
* [example] fix opt tutorial
* [example] fix import
2 years ago
ver217
26b7aac0be
[zero] reorganize zero/gemini folder structure ( #3424 )
...
* [zero] refactor low-level zero folder structure
* [zero] fix legacy zero import path
* [zero] fix legacy zero import path
* [zero] remove useless import
* [zero] refactor gemini folder structure
* [zero] refactor gemini folder structure
* [zero] refactor legacy zero import path
* [zero] refactor gemini folder structure
* [zero] refactor gemini folder structure
* [zero] refactor gemini folder structure
* [zero] refactor legacy zero import path
* [zero] fix test import path
* [zero] fix test
* [zero] fix circular import
* [zero] update import
2 years ago
Jan Roudaut
dd367ce795
[doc] polish diffusion example ( #3386 )
...
* [examples/images/diffusion]: README.md: typo fixes
* Update README.md
* Grammar fixes
* Reformulated "Step 3" (xformers) introduction
to the cost => at the cost + reworded pip availability.
2 years ago
Jan Roudaut
51cd2fec57
Typofix: malformed `xformers` version ( #3384 )
...
s/0.12.0/0.0.12/
2 years ago
YuliangLiu0306
fd6add575d
[examples] polish AutoParallel readme ( #3270 )
2 years ago
Frank Lee
73d3e4d309
[booster] implemented the torch ddd + resnet example ( #3232 )
...
* [booster] implemented the torch ddd + resnet example
* polish code
2 years ago
NatalieC323
280fcdc485
polish code ( #3194 )
...
Co-authored-by: YuliangLiu0306 <72588413+YuliangLiu0306@users.noreply.github.com>
2 years ago
Yan Fang
189347963a
[auto] fix requirements typo for issue #3125 ( #3209 )
2 years ago
NatalieC323
e5f668f280
[dreambooth] fixing the incompatibity in requirements.txt ( #3190 )
...
* Update requirements.txt
* Update environment.yaml
* Update README.md
* Update environment.yaml
* Update README.md
* Update README.md
* Delete requirements_colossalai.txt
* Update requirements.txt
* Update README.md
2 years ago
Zihao
18dbe76cae
[auto-parallel] add auto-offload feature ( #3154 )
...
* add auto-offload feature
* polish code
* fix syn offload runtime pass bug
* add offload example
* fix offload testing bug
* fix example testing bug
2 years ago
NatalieC323
4e921cfbd6
[examples] Solving the diffusion issue of incompatibility issue#3169 ( #3170 )
...
* Update requirements.txt
* Update environment.yaml
* Update README.md
* Update environment.yaml
2 years ago
binmakeswell
3c01280a56
[doc] add community contribution guide ( #3153 )
...
* [doc] update contribution guide
* [doc] update contribution guide
* [doc] add community contribution guide
2 years ago
github-actions[bot]
0aa92c0409
Automated submodule synchronization ( #3105 )
...
Co-authored-by: github-actions <github-actions@github.com>
2 years ago
binmakeswell
018936a3f3
[tutorial] update notes for TransformerEngine ( #3098 )
2 years ago
Kirthi Shankar Sivamani
65a4dbda6c
[NVIDIA] Add FP8 example using TE ( #3080 )
...
Signed-off-by: Kirthi Shankar Sivamani <ksivamani@nvidia.com>
2 years ago
Fazzie-Maqianli
5d5f475d75
[diffusers] fix ci and docker ( #3085 )
2 years ago
Camille Zhong
e58a3c804c
Fix the version of lightning and colossalai in Stable Diffusion environment requirement ( #3073 )
...
1. Modify the README of stable diffusion
2. Fix the version of pytorch lightning&lightning and colossalai version to enable codes running successfully.
2 years ago
binmakeswell
360674283d
[example] fix redundant note ( #3065 )
2 years ago
Tomek
af3888481d
[example] fixed opt model downloading from huggingface
2 years ago
ramos
2ef855c798
support shardinit option to avoid OPT OOM initializing problem ( #3037 )
...
Co-authored-by: poe <poe@nemoramo>
2 years ago
Ziyue Jiang
400f63012e
[pipeline] Add Simplified Alpa DP Partition ( #2507 )
...
* add alpa dp split
* add alpa dp split
* use fwd+bwd instead of fwd only
---------
Co-authored-by: Ziyue Jiang <ziyue.jiang@gmail.com>
2 years ago
binmakeswell
52a5078988
[doc] add ISC tutorial ( #2997 )
...
* [doc] add ISC tutorial
* [doc] add ISC tutorial
* [doc] add ISC tutorial
* [doc] add ISC tutorial
2 years ago
github-actions[bot]
827a0af8cc
Automated submodule synchronization ( #2982 )
...
Co-authored-by: github-actions <github-actions@github.com>
2 years ago
github-actions[bot]
da056285f2
[format] applied code formatting on changed files in pull request 2922 ( #2923 )
...
Co-authored-by: github-actions <github-actions@github.com>
2 years ago
binmakeswell
12bafe057f
[doc] update installation for GPT ( #2922 )
2 years ago
binmakeswell
0afb55fc5b
[doc] add os scope, update tutorial install and tips ( #2914 )
2 years ago
Alex_996
a4fc125c34
Fix typos ( #2863 )
...
Fix typos, `6.7 -> 6.7b`
2 years ago
dawei-wang
55424a16a5
[doc] fix GPT tutorial ( #2860 )
...
Fix hpcaitech/ColossalAI#2851
2 years ago
Zheng Zeng
597914317b
[doc] fix typo in opt inference tutorial ( #2849 )
2 years ago
github-actions[bot]
a5721229d9
Automated submodule synchronization ( #2740 )
...
Co-authored-by: github-actions <github-actions@github.com>
2 years ago
Haofan Wang
47ecb22387
[example] add LoRA support ( #2821 )
...
* add lora
* format
2 years ago
Jiarui Fang
bf0204604f
[exmaple] add bert and albert ( #2824 )
2 years ago
Fazzie-Maqianli
ba84cd80b2
fix pip install colossal ( #2764 )
2 years ago
cloudhuang
43dffdaba5
[doc] fixed a typo in GPT readme ( #2736 )
2 years ago
Fazzie-Maqianli
d03f4429c1
add ci ( #2641 )
2 years ago
github-actions[bot]
d701ef81b1
Automated submodule synchronization ( #2707 )
...
Co-authored-by: github-actions <github-actions@github.com>
2 years ago
github-actions[bot]
88416019e7
Automated submodule synchronization ( #2648 )
...
Co-authored-by: github-actions <github-actions@github.com>
2 years ago
binmakeswell
9ab14b20b5
[doc] add CVPR tutorial ( #2666 )
2 years ago
Jiatong (Julius) Han
a255a38f7f
[example] Polish README.md ( #2658 )
...
* [tutorial] polish readme.md
* [example] Update README.md
2 years ago
Fazzie-Maqianli
292c81ed7c
fix/transformer-verison ( #2581 )
2 years ago
Frank Lee
4ae02c4b1c
[tutorial] added energonai to opt inference requirements ( #2625 )
2 years ago
binmakeswell
0556f5d468
[tutorial] add video link ( #2619 )
2 years ago
github-actions[bot]
ae86be1fd2
Automated submodule synchronization ( #2607 )
...
Co-authored-by: github-actions <github-actions@github.com>
2 years ago
binmakeswell
039b0c487b
[tutorial] polish README ( #2568 )
2 years ago
oahzxl
4f5ef73a43
[tutorial] update fastfold tutorial ( #2565 )
...
* update readme
* update
* update
2 years ago
Fazzie-Maqianli
79079a9d0c
Merge pull request #2561 from Fazziekey/v2
...
bug/fix diffusion ckpt problem
2 years ago
Fazzie
cad1f50512
fix ckpt
2 years ago
YuliangLiu0306
f477a14f4a
[hotfix] fix autoparallel demo ( #2533 )
2 years ago
HELSON
6e0faa70e0
[gemini] add profiler in the demo ( #2534 )
2 years ago
Fazzie
f35326881c
fix README
2 years ago
HELSON
66dfcf5281
[gemini] update the gpt example ( #2527 )
2 years ago
LuGY
ecbad93b65
[example] Add fastfold tutorial ( #2528 )
...
* add fastfold example
* pre-commit polish
* pre-commit polish readme and add empty test ci
* Add test_ci and reduce the default sequence length
2 years ago
Jiarui Fang
fd8d19a6e7
[example] update lightning dependency for stable diffusion ( #2522 )
2 years ago
HELSON
707b11d4a0
[gemini] update ddp strict mode ( #2518 )
...
* [zero] add strict ddp mode for chunk init
* [gemini] update gpt example
2 years ago
HELSON
2d1a7dfe5f
[zero] add strict ddp mode ( #2508 )
...
* [zero] add strict ddp mode
* [polish] add comments for strict ddp mode
* [zero] fix test error
2 years ago
jiaruifang
32390cbe8f
add test_ci.sh to dreambooth
2 years ago
jiaruifang
025b482dc1
[example] dreambooth example
2 years ago
jiaruifang
e58cc441e2
polish code and fix dataloader bugs
2 years ago
jiaruifang
a4b75b78a0
[hotfix] gpt example titans bug #2493
2 years ago
binmakeswell
fcc6d61d92
[example] fix requirements ( #2488 )
2 years ago
Jiarui Fang
3a21485ead
[example] titans for gpt ( #2484 )
2 years ago
Jiarui Fang
7c31706227
[CI] add test_ci.sh for palm, opt and gpt ( #2475 )
2 years ago
Jiarui Fang
e4c38ba367
[example] stable diffusion add roadmap ( #2482 )
2 years ago
ver217
f525d1f528
[example] update gpt gemini example ci test ( #2477 )
2 years ago
Ziyue Jiang
fef5c949c3
polish pp middleware ( #2476 )
...
Co-authored-by: Ziyue Jiang <ziyue.jiang@gmail.com>
2 years ago
Frank Lee
8b7495dd54
[example] integrate seq-parallel tutorial with CI ( #2463 )
2 years ago
ver217
8e85d2440a
[example] update vit ci script ( #2469 )
...
* [example] update vit ci script
* [example] update requirements
* [example] update requirements
2 years ago
Jiarui Fang
867c8c2d3a
[zero] low level optim supports ProcessGroup ( #2464 )
2 years ago
Frank Lee
e6943e2d11
[example] integrate autoparallel demo with CI ( #2466 )
...
* [example] integrate autoparallel demo with CI
* polish code
* polish code
* polish code
* polish code
2 years ago
YuliangLiu0306
c20529fe78
[examples] update autoparallel tutorial demo ( #2449 )
...
* [examples] update autoparallel tutorial demo
* add test_ci.sh
* polish
* add conda yaml
2 years ago
Haofan Wang
cfd1d5ee49
[example] fixed seed error in train_dreambooth_colossalai.py ( #2445 )
2 years ago
Frank Lee
ac18a445fa
[example] updated large-batch optimizer tutorial ( #2448 )
...
* [example] updated large-batch optimizer tutorial
* polish code
* polish code
2 years ago
Frank Lee
39163417a1
[example] updated the hybrid parallel tutorial ( #2444 )
...
* [example] updated the hybrid parallel tutorial
* polish code
2 years ago
YuliangLiu0306
2731531bc2
[autoparallel] integrate device mesh initialization into autoparallelize ( #2393 )
...
* [autoparallel] integrate device mesh initialization into autoparallelize
* add megatron solution
* update gpt autoparallel examples with latest api
* adapt beta value to fit the current computation cost
2 years ago
Frank Lee
a3e5496156
[example] improved the clarity yof the example readme ( #2427 )
...
* [example] improved the clarity yof the example readme
* polish workflow
* polish workflow
* polish workflow
* polish workflow
* polish workflow
* polish workflow
2 years ago
Frank Lee
63be79d505
[example] removed duplicated stable diffusion example ( #2424 )
2 years ago
ZijianYY
fe0f7970a2
[examples] adding tflops to PaLM ( #2365 )
2 years ago
HELSON
d84e747975
[hotfix] add DISTPAN argument for benchmark ( #2412 )
...
* change the benchmark config file
* change config
* revert config file
* rename distpan to distplan
2 years ago
Frank Lee
8327932d2c
[workflow] refactored the example check workflow ( #2411 )
...
* [workflow] refactored the example check workflow
* polish code
* polish code
* polish code
* polish code
* polish code
* polish code
* polish code
* polish code
* polish code
* polish code
* polish code
2 years ago
HELSON
498b5ca993
[hotfix] fix gpt gemini example ( #2404 )
...
* [hotfix] fix gpt gemini example
* [example] add new assertions
2 years ago
jiaruifang
b2e0d502b8
[doc] hotfix #2377
2 years ago
Jiarui Fang
8f72b6f8fb
[hotfix] fix implement error in diffusers
2 years ago
1SAA
33f3023e19
[hotfix] fix implement error in diffusers
2 years ago
Jiarui Fang
12c8bf38d7
[Pipeline] Refine GPT PP Example
2 years ago
Ziyue Jiang
ad00894f7f
polish
2 years ago
Jiarui Fang
1aaeb596c6
[example] gpt, shard init on all processes ( #2366 )
2 years ago
Ziyue Jiang
3a15b20421
Move GPT PP Example
2 years ago
HELSON
48d33b1b17
[gemini] add get static torch model ( #2356 )
2 years ago
Fazzie-Maqianli
7a332b1734
Merge pull request #2338 from haofanwang/patch-1
...
Fix a typo in train_dreambooth_colossalai.py
2 years ago
YuliangLiu0306
8b1e0dfd80
[example] upload auto parallel gpt2 demo ( #2354 )
2 years ago
Jiarui Fang
00a9c781fd
[example] add google doc for benchmark results of GPT ( #2355 )
2 years ago
Jiarui Fang
509a87f3ff
[example] make gpt example directory more clear ( #2353 )
2 years ago
Ikko Eltociear Ashimine
5e4bced0a3
[NFC] Update roberta/README.md ( #2350 )
2 years ago
Jiarui Fang
35e22be2f6
[example] simplify opt example ( #2344 )
2 years ago
ziyuhuang123
7080a8edb0
[workflow]New version: Create workflow files for examples' auto check ( #2298 )
...
* [workflows]bug_repair
* [workflow]new_pr_fixing_bugs
Co-authored-by: binmakeswell <binmakeswell@gmail.com>
2 years ago
binmakeswell
d7352bef2c
[example] add example requirement ( #2345 )
2 years ago
Haofan Wang
7ce965c7cc
Update requirement_colossalai.txt ( #2348 )
2 years ago
ZijianYY
f7fd592bf4
[examples]adding tp to PaLM ( #2319 )
2 years ago
Haofan Wang
9edd0aa75e
Update train_dreambooth_colossalai.py
...
accelerator.num_processes -> gpc.get_world_size(ParallelMode.DATA)
2 years ago
Fazzie-Maqianli
89f26331e9
[example] diffusion update diffusion,Dreamblooth ( #2329 )
2 years ago
binmakeswell
e512ca9c24
[doc] update stable diffusion link ( #2322 )
...
* [doc] update link
2 years ago
Fazzie-Maqianli
a9b27b9265
[exmaple] fix dreamblooth format ( #2315 )
2 years ago
Jiarui Fang
32253315b4
[example] update diffusion readme with official lightning ( #2304 )
2 years ago
HELSON
e00cedd181
[example] update gemini benchmark bash ( #2306 )
2 years ago
binmakeswell
c8144223b8
[doc] update diffusion doc ( #2296 )
2 years ago
ZijianYY
df1d6dc553
[examples] using args and combining two versions for PaLM ( #2284 )
2 years ago
Ziyue Jiang
ac863a01d6
[example] add benchmark ( #2276 )
...
* add benchmark
* merge common func
* add total and avg tflops
Co-authored-by: Ziyue Jiang <ziyue.jiang@gmail.com>
2 years ago
BlueRum
1405b4381e
[example] fix save_load bug for dreambooth ( #2280 )
2 years ago
Jiarui Fang
879df8b943
[example] GPT polish readme ( #2274 )
2 years ago
Ziyue Jiang
9654df0e9a
Add GPT PP Example ( #2272 )
...
Co-authored-by: Ziyue Jiang <ziyue.jiang@gmail.com>
2 years ago
YuliangLiu0306
4b29112ab2
[autoparallel] gpt2 autoparallel examples ( #2267 )
...
* [autoparallel] gpt2 autoparallel examples
* polish code
* polish code
2 years ago
HELSON
09c0102fe6
[example] fix gpt example with 0.1.10 ( #2265 )
2 years ago
Fazzie-Maqianli
89f048a88a
[example] clear diffuser image ( #2262 )
2 years ago
Frank Lee
89542ceb44
[doc] updated the stable diffussion on docker usage ( #2244 )
...
* [doc] updated the stable diffussion on docker usage
* polish doc
2 years ago
Jiarui Fang
50cdf5430e
[example] diffusion install from docker ( #2239 )
...
* [builder] builder for scaled_upper_triang_masked_softmax
* add missing files
* fix a bug
* polish code
* [example] diffusion install from docker
2 years ago
Jiarui Fang
db4cbdc7fb
[builder] builder for scaled_upper_triang_masked_softmax ( #2234 )
2 years ago
HELSON
31fe84237b
[example] fix benchmark.sh for gpt example ( #2229 )
2 years ago
Jiarui Fang
2cdecc9f38
[example] make palm + GeminiDPP work ( #2227 )
2 years ago
ZijianYY
63cc77173b
[example] Palm adding gemini, still has bugs ( #2221 )
2 years ago
HELSON
7010e18134
[example] update gpt example ( #2225 )
2 years ago
Jiarui Fang
49c601da21
[example] add benchmark.sh for gpt ( #2226 )
2 years ago
HELSON
3629e611cd
[example] update gpt benchmark ( #2219 )
2 years ago
ZijianYY
92de90dfb3
[examples] replace einsum with matmul ( #2210 )
2 years ago
Jiarui Fang
7675792100
[builder] raise Error when CUDA_HOME is not set ( #2213 )
2 years ago
HELSON
78a89d9b41
[diffusion] update readme ( #2214 )
2 years ago
Jiarui Fang
d96cc37e32
[example] update GPT example benchmark results ( #2212 )
2 years ago
Jiarui Fang
d5e3e3ec01
[example] update gpt example for larger model scale ( #2211 )
2 years ago
Jiarui Fang
29868a9ec1
[example] update gpt readme with performance ( #2206 )
2 years ago
BlueRum
6642cebdbe
[example] Change some training settings for diffusion ( #2195 )
2 years ago
ziyuhuang123
4363ff3e41
'[NFC] fix some typos' ( #2175 )
2 years ago
Fazzie-Maqianli
ce3c4eca7b
[example] support Dreamblooth ( #2188 )
2 years ago
BlueRum
1cf6d92d7c
[exmaple] diffuser, support quant inference for stable diffusion ( #2186 )
2 years ago
Jiarui Fang
65f56f49e8
[example] gpt demo more accuracy tflops ( #2178 )
2 years ago
ziyuhuang123
cf5028363c
'diffusion-typo-change'
2 years ago
Jiarui Fang
27327a4c90
[example] add palm pytorch version ( #2172 )
2 years ago
Jiarui Fang
a4b4bb01d6
[example] update vit readme ( #2155 )
2 years ago
Jiarui Fang
2cfe685b9f
[exmaple] add vit missing functions ( #2154 )
2 years ago
HELSON
a7d95b7024
[example] add zero1, zero2 example in GPT examples ( #2146 )
...
* [example] add zero1 and zero2 for GPT
* update readme in gpt example
* polish code
* change init value
* update readme
2 years ago
Fazzie
cea4292ae5
support stable diffusion v2
2 years ago
ZijianYY
fa9d1aea71
[example] update GPT README ( #2095 )
2 years ago
YuliangLiu0306
edf4cd46c5
[examples] update autoparallel demo ( #2061 )
2 years ago
Super Daniel
2edbef13cc
[fx] add more meta_registry for MetaTensor execution. ( #2000 )
...
* [sc] add examples for auto checkpoint.
* merge upstream
* [fx] add more meta_registry for MetaTensor execution.
2 years ago
Fazzie-Maqianli
b5dbb46172
[example] add diffusion inference ( #1986 )
2 years ago
mandoxzhang
52bd106627
add RoBERTa ( #1980 )
...
* update roberta
* update roberta & readme
* update roberta & readme
* update roberta & readme
2 years ago
Jiarui Fang
f7e276fa71
[Gemini] add GeminiAdamOptimizer ( #1960 )
2 years ago
Jiarui Fang
60abd86d6a
[example] enhance GPT demo ( #1959 )
...
* [example] enhence GPT demo
* Update README.md
Co-authored-by: binmakeswell <binmakeswell@gmail.com>
2 years ago
Fazzie
a09f88ab07
update model download in README
2 years ago
Fazzie-Maqianli
6bdd0a90ca
update lightning version ( #1954 )
2 years ago
binmakeswell
9183e0dec5
[tutorial] polish all README ( #1946 )
2 years ago
Frank Lee
de56b563b9
[tutorial] added missing dummy dataloader ( #1944 )
2 years ago
Frank Lee
c6ea65011f
[tutorial] fixed pipeline bug for sequence parallel ( #1943 )
2 years ago
Jiarui Fang
cf68cc92ac
[example] add vit ( #1942 )
...
* [ColoTensor] ColoInitContext initialize parameters in shard mode.
* polish
* [example] add vit
2 years ago
YuliangLiu0306
c7925c5d08
[sc demo] add requirements to spmd README ( #1941 )
2 years ago
Boyuan Yao
d5f5e06d82
[SC] remove redundant hands on ( #1939 )
...
* [sc] SC tutorial for auto checkpoint
* [sc] polish examples
* [sc] polish readme
* [sc] polish readme and help information
* [sc] polish readme and help information
* [sc] modify auto checkpoint benchmark
* [sc] remove imgs
* [sc] remove redundant handson
2 years ago
binmakeswell
41868f7605
[tutorial] polish README and OPT files ( #1930 )
...
* [tutorial] polish README and OPT files
* [tutorial] polish README and OPT files
* [tutorial] polish README and OPT files
2 years ago
ver217
b0b7a786b7
[tutorial] add synthetic dataset for opt ( #1924 )
2 years ago
Frank Lee
0486048453
[tutorial] updated hybrid parallel readme ( #1928 )
...
* [tutorial] updated hybrid parallel readme
* polish code
2 years ago
Frank Lee
807cbdb87d
[tutorial] added synthetic data for sequence parallel ( #1927 )
...
* [tutorial] added synthetic data for sequence parallel
* polish code
2 years ago
Frank Lee
abf4c27f6a
[tutorial] removed huggingface model warning ( #1925 )
2 years ago
Frank Lee
d43a671ad6
Hotfix/tutorial readme index ( #1922 )
...
* [tutorial] removed tutorial index in readme
* [tutorial] removed tutorial index in readme
2 years ago
Boyuan Yao
24cbee0ebe
[tutorial] modify hands-on of auto activation checkpoint ( #1920 )
...
* [sc] SC tutorial for auto checkpoint
* [sc] polish examples
* [sc] polish readme
* [sc] polish readme and help information
* [sc] polish readme and help information
* [sc] modify auto checkpoint benchmark
* [sc] remove imgs
2 years ago
Frank Lee
ff16773ded
[tutorial] added synthetic data for hybrid parallel ( #1921 )
...
* [tutorial] added synthetic data for hybrid parallel
* polish code
2 years ago
Frank Lee
3c42fdbedc
[tutorial] added synthetic data for hybrid parallel ( #1919 )
2 years ago
Frank Lee
1b0dd05940
[tutorial] added synthetic dataset for auto parallel demo ( #1918 )
2 years ago
Frank Lee
acd9abc5ca
[tutorial] updated auto parallel demo with latest data path ( #1917 )
2 years ago
Frank Lee
d53415bc10
[tutorial] added data script and updated readme ( #1916 )
2 years ago
binmakeswell
155e202318
[example] update auto_parallel img path ( #1910 )
2 years ago
Boyuan Yao
d5c5bc219e
[SC] add GPT example for auto checkpoint ( #1889 )
...
* [sc] SC tutorial for auto checkpoint
* [sc] polish examples
* [sc] polish readme
* [sc] polish readme and help information
* [sc] polish readme and help information
2 years ago
binmakeswell
11ee8ae478
[tutorial] add cifar10 for diffusion ( #1907 )
2 years ago
Frank Lee
cb7ec714c8
[tutorial] removed duplicated tutorials ( #1904 )
2 years ago
Fazzie-Maqianli
351f0f64e6
[example] add cifar10 dadaset for diffusion ( #1902 )
...
* add cifar10 dadasets
* Update README.md
Co-authored-by: binmakeswell <binmakeswell@gmail.com>
2 years ago
BoxiangW
ca6e75bc28
[tutorial] edited hands-on practices ( #1899 )
...
* Add handson to ColossalAI.
* Change names of handsons and edit sequence parallel example.
* Edit wrong folder name
* resolve conflict
* delete readme
2 years ago
BoxiangW
d9bf83e084
Add handson to ColossalAI. ( #1896 )
...
Co-authored-by: Boxiang Wang <boxiang.wang1@gmail.com>
2 years ago
Super Daniel
6d559ea614
[sc] add examples for auto checkpoint. ( #1880 )
2 years ago
HELSON
f9e7d179f2
[diffusion] fix package conflicts ( #1875 )
2 years ago
binmakeswell
610dda676c
[example] migrate diffusion and auto_parallel hands-on ( #1871 )
2 years ago
binmakeswell
50c4cb0167
[NFC] remove redundant dependency ( #1869 )
...
* remove redundant config
* remove redundant dependency
2 years ago
binmakeswell
fd8f0ca5a8
[example] initialize tutorial ( #1865 )
2 years ago
binmakeswell
e9635eb493
add explanation specified version
2 years ago
jiaruifang
27211d6267
[example] polish diffusion readme
2 years ago
binmakeswell
4ac7d3ec3b
[doc] polish diffusion README ( #1840 )
2 years ago
Jiarui Fang
f86a703bcf
[NFC] update gitignore remove DS_Store ( #1830 )
2 years ago
Jiarui Fang
a25f755331
[example] add TP to GPT example ( #1828 )
2 years ago
Fazzie-Maqianli
6e9730d7ab
[example] add stable diffuser ( #1825 )
2 years ago
Jiarui Fang
b1263d32ba
[example] simplify the GPT2 huggingface example ( #1826 )
2 years ago
Jiarui Fang
cd5a0d56fa
[Gemini] make gemini usage simple ( #1821 )
2 years ago
Maruyama_Aya
a7e8159da6
add ColoDiffusion codes: /ldm/module/, /ldm/data/, /scripts/test/
2 years ago
Jiarui Fang
350ccc0481
[example] opt does not depend on Titans ( #1811 )
2 years ago
Jiarui Fang
203ca57aed
[example] add GPT
2 years ago
Jiarui Fang
fd2c8d8156
[example] add opt model in lauguage ( #1809 )
2 years ago
Jiarui Fang
f5a92c288c
[example] add diffusion to example ( #1805 )
2 years ago
Jiarui Fang
a19eb80998
[embedding] updates some default parameters
2 years ago
github-actions[bot]
177d3f5718
Automated submodule synchronization ( #1465 )
...
Co-authored-by: github-actions <github-actions@github.com>
2 years ago
github-actions[bot]
9b442ecdc3
Automated submodule synchronization ( #1404 )
...
Co-authored-by: github-actions <github-actions@github.com>
2 years ago
github-actions[bot]
1e5eb0874c
Automated submodule synchronization ( #1396 )
...
Co-authored-by: github-actions <github-actions@github.com>
2 years ago
github-actions[bot]
50dec605e1
Automated submodule synchronization ( #1380 )
...
Co-authored-by: github-actions <github-actions@github.com>
2 years ago
github-actions[bot]
fb6f085907
Automated submodule synchronization ( #1372 )
...
Co-authored-by: github-actions <github-actions@github.com>
2 years ago
github-actions[bot]
6160a1d6a7
Automated submodule synchronization ( #1348 )
...
Co-authored-by: github-actions <github-actions@github.com>
2 years ago
github-actions[bot]
6f2f9eb214
Automated submodule synchronization ( #1305 )
...
Co-authored-by: github-actions <github-actions@github.com>
2 years ago
github-actions[bot]
762905da68
Automated submodule synchronization ( #1241 )
...
Co-authored-by: github-actions <github-actions@github.com>
2 years ago
github-actions[bot]
4951f7d80c
Automated submodule synchronization ( #1204 )
...
Co-authored-by: github-actions <github-actions@github.com>
2 years ago
github-actions[bot]
23442a5bc1
Automated submodule synchronization ( #1194 )
...
Co-authored-by: github-actions <github-actions@github.com>
2 years ago
github-actions[bot]
6f0733a1ef
Automated submodule synchronization ( #1159 )
...
Co-authored-by: github-actions <github-actions@github.com>
2 years ago
github-actions[bot]
e8c34eedfd
Automated submodule synchronization ( #1129 )
...
Co-authored-by: github-actions <github-actions@github.com>
2 years ago
github-actions[bot]
85b58093d2
Automated submodule synchronization ( #1105 )
...
Co-authored-by: github-actions <github-actions@github.com>
2 years ago
github-actions[bot]
e32470b6de
Automated submodule synchronization ( #1049 )
...
Co-authored-by: github-actions <github-actions@github.com>
3 years ago
github-actions[bot]
4d8a574cd3
Automated submodule synchronization ( #1034 )
...
Co-authored-by: github-actions <github-actions@github.com>
3 years ago
github-actions[bot]
9e3d602dba
Automated submodule synchronization ( #1003 )
...
Co-authored-by: github-actions <github-actions@github.com>
3 years ago
github-actions[bot]
46bc95708f
Automated submodule synchronization ( #960 )
...
Co-authored-by: github-actions <github-actions@github.com>
3 years ago
github-actions[bot]
7edb38193a
Automated submodule synchronization ( #932 )
...
Co-authored-by: github-actions <github-actions@github.com>
3 years ago
github-actions[bot]
b61d64685f
Automated submodule synchronization ( #929 )
...
Co-authored-by: github-actions <github-actions@github.com>
3 years ago
github-actions[bot]
1cf7fb3cd9
Automated submodule synchronization ( #912 )
...
Co-authored-by: github-actions <github-actions@github.com>
3 years ago
github-actions[bot]
3b1f5f07ce
Automated submodule synchronization ( #907 )
...
Co-authored-by: github-actions <github-actions@github.com>
3 years ago
github-actions[bot]
f271f34716
Automated submodule synchronization ( #827 )
...
Co-authored-by: github-actions <github-actions@github.com>
3 years ago
github-actions[bot]
413ce30c45
Automated submodule synchronization ( #819 )
...
Co-authored-by: github-actions <github-actions@github.com>
3 years ago
github-actions[bot]
9aae4197bb
Automated submodule synchronization ( #810 )
...
Co-authored-by: github-actions <github-actions@github.com>
3 years ago
github-actions[bot]
6978980f6d
Automated submodule synchronization ( #751 )
...
Co-authored-by: github-actions <github-actions@github.com>
3 years ago
github-actions[bot]
d878d843ad
Automated submodule synchronization ( #695 )
...
Co-authored-by: github-actions <github-actions@github.com>
3 years ago
github-actions[bot]
d50cdabbc9
Automated submodule synchronization ( #556 )
...
Co-authored-by: github-actions <github-actions@github.com>
3 years ago
github-actions[bot]
92f4224867
Automated submodule synchronization ( #501 )
3 years ago
github-actions[bot]
353566c198
Automated submodule synchronization ( #483 )
...
Co-authored-by: github-actions <github-actions@github.com>
3 years ago
github-actions[bot]
cfcc8271f3
[Bot] Automated submodule synchronization ( #451 )
...
Co-authored-by: github-actions <github-actions@github.com>
3 years ago