Commit Graph

392 Commits (d3f34ee8cc48b089c8b7dbc55697f77719f33079)

Author SHA1 Message Date
Frank Lee 80eba05b0a
[test] refactor tests with spawn (#3452)
2 years ago
Frank Lee 7d8d825681
[booster] fixed the torch ddp plugin with the new checkpoint api (#3442)
2 years ago
ver217 573af84184
[example] update examples related to zero/gemini (#3431)
2 years ago
ver217 26b7aac0be
[zero] reorganize zero/gemini folder structure (#3424)
2 years ago
Jan Roudaut dd367ce795
[doc] polish diffusion example (#3386)
2 years ago
Jan Roudaut 51cd2fec57
Typofix: malformed `xformers` version (#3384)
2 years ago
YuliangLiu0306 fd6add575d
[examples] polish AutoParallel readme (#3270)
2 years ago
Frank Lee 73d3e4d309
[booster] implemented the torch ddd + resnet example (#3232)
2 years ago
NatalieC323 280fcdc485
polish code (#3194)
2 years ago
Yan Fang 189347963a
[auto] fix requirements typo for issue #3125 (#3209)
2 years ago
NatalieC323 e5f668f280
[dreambooth] fixing the incompatibity in requirements.txt (#3190)
2 years ago
Zihao 18dbe76cae
[auto-parallel] add auto-offload feature (#3154)
2 years ago
NatalieC323 4e921cfbd6
[examples] Solving the diffusion issue of incompatibility issue#3169 (#3170)
2 years ago
binmakeswell 3c01280a56
[doc] add community contribution guide (#3153)
2 years ago
github-actions[bot] 0aa92c0409
Automated submodule synchronization (#3105)
2 years ago
binmakeswell 018936a3f3
[tutorial] update notes for TransformerEngine (#3098)
2 years ago
Kirthi Shankar Sivamani 65a4dbda6c
[NVIDIA] Add FP8 example using TE (#3080)
2 years ago
Fazzie-Maqianli 5d5f475d75
[diffusers] fix ci and docker (#3085)
2 years ago
Camille Zhong e58a3c804c
Fix the version of lightning and colossalai in Stable Diffusion environment requirement (#3073)
2 years ago
binmakeswell 360674283d
[example] fix redundant note (#3065)
2 years ago
Tomek af3888481d
[example] fixed opt model downloading from huggingface
2 years ago
ramos 2ef855c798
support shardinit option to avoid OPT OOM initializing problem (#3037)
2 years ago
Ziyue Jiang 400f63012e
[pipeline] Add Simplified Alpa DP Partition (#2507)
2 years ago
binmakeswell 52a5078988
[doc] add ISC tutorial (#2997)
2 years ago
github-actions[bot] 827a0af8cc
Automated submodule synchronization (#2982)
2 years ago
github-actions[bot] da056285f2
[format] applied code formatting on changed files in pull request 2922 (#2923)
2 years ago
binmakeswell 12bafe057f
[doc] update installation for GPT (#2922)
2 years ago
binmakeswell 0afb55fc5b
[doc] add os scope, update tutorial install and tips (#2914)
2 years ago
Alex_996 a4fc125c34
Fix typos (#2863)
2 years ago
dawei-wang 55424a16a5
[doc] fix GPT tutorial (#2860)
2 years ago
Zheng Zeng 597914317b
[doc] fix typo in opt inference tutorial (#2849)
2 years ago
github-actions[bot] a5721229d9
Automated submodule synchronization (#2740)
2 years ago
Haofan Wang 47ecb22387
[example] add LoRA support (#2821)
2 years ago
Jiarui Fang bf0204604f
[exmaple] add bert and albert (#2824)
2 years ago
Fazzie-Maqianli ba84cd80b2
fix pip install colossal (#2764)
2 years ago
cloudhuang 43dffdaba5
[doc] fixed a typo in GPT readme (#2736)
2 years ago
Fazzie-Maqianli d03f4429c1
add ci (#2641)
2 years ago
github-actions[bot] d701ef81b1
Automated submodule synchronization (#2707)
2 years ago
github-actions[bot] 88416019e7
Automated submodule synchronization (#2648)
2 years ago
binmakeswell 9ab14b20b5
[doc] add CVPR tutorial (#2666)
2 years ago
Jiatong (Julius) Han a255a38f7f
[example] Polish README.md (#2658)
2 years ago
Fazzie-Maqianli 292c81ed7c
fix/transformer-verison (#2581)
2 years ago
Frank Lee 4ae02c4b1c
[tutorial] added energonai to opt inference requirements (#2625)
2 years ago
binmakeswell 0556f5d468
[tutorial] add video link (#2619)
2 years ago
github-actions[bot] ae86be1fd2
Automated submodule synchronization (#2607)
2 years ago
binmakeswell 039b0c487b
[tutorial] polish README (#2568)
2 years ago
oahzxl 4f5ef73a43
[tutorial] update fastfold tutorial (#2565)
2 years ago
Fazzie-Maqianli 79079a9d0c
Merge pull request #2561 from Fazziekey/v2
2 years ago
Fazzie cad1f50512 fix ckpt
2 years ago
YuliangLiu0306 f477a14f4a
[hotfix] fix autoparallel demo (#2533)
2 years ago
HELSON 6e0faa70e0
[gemini] add profiler in the demo (#2534)
2 years ago
Fazzie f35326881c fix README
2 years ago
HELSON 66dfcf5281
[gemini] update the gpt example (#2527)
2 years ago
LuGY ecbad93b65
[example] Add fastfold tutorial (#2528)
2 years ago
Jiarui Fang fd8d19a6e7
[example] update lightning dependency for stable diffusion (#2522)
2 years ago
HELSON 707b11d4a0
[gemini] update ddp strict mode (#2518)
2 years ago
HELSON 2d1a7dfe5f
[zero] add strict ddp mode (#2508)
2 years ago
jiaruifang 32390cbe8f add test_ci.sh to dreambooth
2 years ago
jiaruifang 025b482dc1 [example] dreambooth example
2 years ago
jiaruifang e58cc441e2 polish code and fix dataloader bugs
2 years ago
jiaruifang a4b75b78a0 [hotfix] gpt example titans bug #2493
2 years ago
binmakeswell fcc6d61d92
[example] fix requirements (#2488)
2 years ago
Jiarui Fang 3a21485ead
[example] titans for gpt (#2484)
2 years ago
Jiarui Fang 7c31706227
[CI] add test_ci.sh for palm, opt and gpt (#2475)
2 years ago
Jiarui Fang e4c38ba367
[example] stable diffusion add roadmap (#2482)
2 years ago
ver217 f525d1f528
[example] update gpt gemini example ci test (#2477)
2 years ago
Ziyue Jiang fef5c949c3
polish pp middleware (#2476)
2 years ago
Frank Lee 8b7495dd54
[example] integrate seq-parallel tutorial with CI (#2463)
2 years ago
ver217 8e85d2440a
[example] update vit ci script (#2469)
2 years ago
Jiarui Fang 867c8c2d3a
[zero] low level optim supports ProcessGroup (#2464)
2 years ago
Frank Lee e6943e2d11
[example] integrate autoparallel demo with CI (#2466)
2 years ago
YuliangLiu0306 c20529fe78
[examples] update autoparallel tutorial demo (#2449)
2 years ago
Haofan Wang cfd1d5ee49
[example] fixed seed error in train_dreambooth_colossalai.py (#2445)
2 years ago
Frank Lee ac18a445fa
[example] updated large-batch optimizer tutorial (#2448)
2 years ago
Frank Lee 39163417a1
[example] updated the hybrid parallel tutorial (#2444)
2 years ago
YuliangLiu0306 2731531bc2
[autoparallel] integrate device mesh initialization into autoparallelize (#2393)
2 years ago
Frank Lee a3e5496156
[example] improved the clarity yof the example readme (#2427)
2 years ago
Frank Lee 63be79d505
[example] removed duplicated stable diffusion example (#2424)
2 years ago
ZijianYY fe0f7970a2
[examples] adding tflops to PaLM (#2365)
2 years ago
HELSON d84e747975
[hotfix] add DISTPAN argument for benchmark (#2412)
2 years ago
Frank Lee 8327932d2c
[workflow] refactored the example check workflow (#2411)
2 years ago
HELSON 498b5ca993
[hotfix] fix gpt gemini example (#2404)
2 years ago
jiaruifang b2e0d502b8 [doc] hotfix #2377
2 years ago
Jiarui Fang 8f72b6f8fb
[hotfix] fix implement error in diffusers
2 years ago
1SAA 33f3023e19 [hotfix] fix implement error in diffusers
2 years ago
Jiarui Fang 12c8bf38d7
[Pipeline] Refine GPT PP Example
2 years ago
Ziyue Jiang ad00894f7f polish
2 years ago
Jiarui Fang 1aaeb596c6
[example] gpt, shard init on all processes (#2366)
2 years ago
Ziyue Jiang 3a15b20421 Move GPT PP Example
2 years ago
HELSON 48d33b1b17
[gemini] add get static torch model (#2356)
2 years ago
Fazzie-Maqianli 7a332b1734
Merge pull request #2338 from haofanwang/patch-1
2 years ago
YuliangLiu0306 8b1e0dfd80
[example] upload auto parallel gpt2 demo (#2354)
2 years ago
Jiarui Fang 00a9c781fd
[example] add google doc for benchmark results of GPT (#2355)
2 years ago
Jiarui Fang 509a87f3ff
[example] make gpt example directory more clear (#2353)
2 years ago
Ikko Eltociear Ashimine 5e4bced0a3
[NFC] Update roberta/README.md (#2350)
2 years ago
Jiarui Fang 35e22be2f6
[example] simplify opt example (#2344)
2 years ago
ziyuhuang123 7080a8edb0
[workflow]New version: Create workflow files for examples' auto check (#2298)
2 years ago
binmakeswell d7352bef2c
[example] add example requirement (#2345)
2 years ago
Haofan Wang 7ce965c7cc
Update requirement_colossalai.txt (#2348)
2 years ago
ZijianYY f7fd592bf4
[examples]adding tp to PaLM (#2319)
2 years ago
Haofan Wang 9edd0aa75e
Update train_dreambooth_colossalai.py
2 years ago
Fazzie-Maqianli 89f26331e9
[example] diffusion update diffusion,Dreamblooth (#2329)
2 years ago
binmakeswell e512ca9c24
[doc] update stable diffusion link (#2322)
2 years ago
Fazzie-Maqianli a9b27b9265
[exmaple] fix dreamblooth format (#2315)
2 years ago
Jiarui Fang 32253315b4
[example] update diffusion readme with official lightning (#2304)
2 years ago
HELSON e00cedd181
[example] update gemini benchmark bash (#2306)
2 years ago
binmakeswell c8144223b8
[doc] update diffusion doc (#2296)
2 years ago
ZijianYY df1d6dc553
[examples] using args and combining two versions for PaLM (#2284)
2 years ago
Ziyue Jiang ac863a01d6
[example] add benchmark (#2276)
2 years ago
BlueRum 1405b4381e
[example] fix save_load bug for dreambooth (#2280)
2 years ago
Jiarui Fang 879df8b943
[example] GPT polish readme (#2274)
2 years ago
Ziyue Jiang 9654df0e9a
Add GPT PP Example (#2272)
2 years ago
YuliangLiu0306 4b29112ab2
[autoparallel] gpt2 autoparallel examples (#2267)
2 years ago
HELSON 09c0102fe6
[example] fix gpt example with 0.1.10 (#2265)
2 years ago
Fazzie-Maqianli 89f048a88a
[example] clear diffuser image (#2262)
2 years ago
Frank Lee 89542ceb44
[doc] updated the stable diffussion on docker usage (#2244)
2 years ago
Jiarui Fang 50cdf5430e
[example] diffusion install from docker (#2239)
2 years ago
Jiarui Fang db4cbdc7fb
[builder] builder for scaled_upper_triang_masked_softmax (#2234)
2 years ago
HELSON 31fe84237b
[example] fix benchmark.sh for gpt example (#2229)
2 years ago
Jiarui Fang 2cdecc9f38
[example] make palm + GeminiDPP work (#2227)
2 years ago
ZijianYY 63cc77173b
[example] Palm adding gemini, still has bugs (#2221)
2 years ago
HELSON 7010e18134
[example] update gpt example (#2225)
2 years ago
Jiarui Fang 49c601da21
[example] add benchmark.sh for gpt (#2226)
2 years ago
HELSON 3629e611cd
[example] update gpt benchmark (#2219)
2 years ago
ZijianYY 92de90dfb3
[examples] replace einsum with matmul (#2210)
2 years ago
Jiarui Fang 7675792100
[builder] raise Error when CUDA_HOME is not set (#2213)
2 years ago
HELSON 78a89d9b41
[diffusion] update readme (#2214)
2 years ago
Jiarui Fang d96cc37e32
[example] update GPT example benchmark results (#2212)
2 years ago
Jiarui Fang d5e3e3ec01
[example] update gpt example for larger model scale (#2211)
2 years ago
Jiarui Fang 29868a9ec1
[example] update gpt readme with performance (#2206)
2 years ago
BlueRum 6642cebdbe
[example] Change some training settings for diffusion (#2195)
2 years ago
ziyuhuang123 4363ff3e41
'[NFC] fix some typos' (#2175)
2 years ago
Fazzie-Maqianli ce3c4eca7b
[example] support Dreamblooth (#2188)
2 years ago
BlueRum 1cf6d92d7c
[exmaple] diffuser, support quant inference for stable diffusion (#2186)
2 years ago
Jiarui Fang 65f56f49e8
[example] gpt demo more accuracy tflops (#2178)
2 years ago
ziyuhuang123 cf5028363c 'diffusion-typo-change'
2 years ago
Jiarui Fang 27327a4c90
[example] add palm pytorch version (#2172)
2 years ago
Jiarui Fang a4b4bb01d6
[example] update vit readme (#2155)
2 years ago
Jiarui Fang 2cfe685b9f
[exmaple] add vit missing functions (#2154)
2 years ago
HELSON a7d95b7024
[example] add zero1, zero2 example in GPT examples (#2146)
2 years ago
Fazzie cea4292ae5 support stable diffusion v2
2 years ago
ZijianYY fa9d1aea71
[example] update GPT README (#2095)
2 years ago
YuliangLiu0306 edf4cd46c5
[examples] update autoparallel demo (#2061)
2 years ago
Super Daniel 2edbef13cc
[fx] add more meta_registry for MetaTensor execution. (#2000)
2 years ago
Fazzie-Maqianli b5dbb46172
[example] add diffusion inference (#1986)
2 years ago
mandoxzhang 52bd106627
add RoBERTa (#1980)
2 years ago
Jiarui Fang f7e276fa71
[Gemini] add GeminiAdamOptimizer (#1960)
2 years ago
Jiarui Fang 60abd86d6a
[example] enhance GPT demo (#1959)
2 years ago
Fazzie a09f88ab07 update model download in README
2 years ago
Fazzie-Maqianli 6bdd0a90ca
update lightning version (#1954)
2 years ago
binmakeswell 9183e0dec5
[tutorial] polish all README (#1946)
2 years ago
Frank Lee de56b563b9
[tutorial] added missing dummy dataloader (#1944)
2 years ago
Frank Lee c6ea65011f
[tutorial] fixed pipeline bug for sequence parallel (#1943)
2 years ago
Jiarui Fang cf68cc92ac
[example] add vit (#1942)
2 years ago
YuliangLiu0306 c7925c5d08
[sc demo] add requirements to spmd README (#1941)
2 years ago
Boyuan Yao d5f5e06d82
[SC] remove redundant hands on (#1939)
2 years ago
binmakeswell 41868f7605
[tutorial] polish README and OPT files (#1930)
2 years ago
ver217 b0b7a786b7
[tutorial] add synthetic dataset for opt (#1924)
2 years ago
Frank Lee 0486048453
[tutorial] updated hybrid parallel readme (#1928)
2 years ago
Frank Lee 807cbdb87d
[tutorial] added synthetic data for sequence parallel (#1927)
2 years ago
Frank Lee abf4c27f6a
[tutorial] removed huggingface model warning (#1925)
2 years ago
Frank Lee d43a671ad6
Hotfix/tutorial readme index (#1922)
2 years ago
Boyuan Yao 24cbee0ebe
[tutorial] modify hands-on of auto activation checkpoint (#1920)
2 years ago
Frank Lee ff16773ded
[tutorial] added synthetic data for hybrid parallel (#1921)
2 years ago
Frank Lee 3c42fdbedc
[tutorial] added synthetic data for hybrid parallel (#1919)
2 years ago
Frank Lee 1b0dd05940
[tutorial] added synthetic dataset for auto parallel demo (#1918)
2 years ago
Frank Lee acd9abc5ca
[tutorial] updated auto parallel demo with latest data path (#1917)
2 years ago
Frank Lee d53415bc10
[tutorial] added data script and updated readme (#1916)
2 years ago
binmakeswell 155e202318
[example] update auto_parallel img path (#1910)
2 years ago
Boyuan Yao d5c5bc219e
[SC] add GPT example for auto checkpoint (#1889)
2 years ago
binmakeswell 11ee8ae478
[tutorial] add cifar10 for diffusion (#1907)
2 years ago
Frank Lee cb7ec714c8
[tutorial] removed duplicated tutorials (#1904)
2 years ago
Fazzie-Maqianli 351f0f64e6
[example] add cifar10 dadaset for diffusion (#1902)
2 years ago
BoxiangW ca6e75bc28
[tutorial] edited hands-on practices (#1899)
2 years ago
BoxiangW d9bf83e084
Add handson to ColossalAI. (#1896)
2 years ago
Super Daniel 6d559ea614
[sc] add examples for auto checkpoint. (#1880)
2 years ago
HELSON f9e7d179f2
[diffusion] fix package conflicts (#1875)
2 years ago
binmakeswell 610dda676c
[example] migrate diffusion and auto_parallel hands-on (#1871)
2 years ago
binmakeswell 50c4cb0167
[NFC] remove redundant dependency (#1869)
2 years ago
binmakeswell fd8f0ca5a8
[example] initialize tutorial (#1865)
2 years ago
binmakeswell e9635eb493 add explanation specified version
2 years ago
jiaruifang 27211d6267 [example] polish diffusion readme
2 years ago
binmakeswell 4ac7d3ec3b
[doc] polish diffusion README (#1840)
2 years ago
Jiarui Fang f86a703bcf
[NFC] update gitignore remove DS_Store (#1830)
2 years ago
Jiarui Fang a25f755331
[example] add TP to GPT example (#1828)
2 years ago
Fazzie-Maqianli 6e9730d7ab
[example] add stable diffuser (#1825)
2 years ago
Jiarui Fang b1263d32ba
[example] simplify the GPT2 huggingface example (#1826)
2 years ago
Jiarui Fang cd5a0d56fa
[Gemini] make gemini usage simple (#1821)
2 years ago
Maruyama_Aya a7e8159da6 add ColoDiffusion codes: /ldm/module/, /ldm/data/, /scripts/test/
2 years ago
Jiarui Fang 350ccc0481
[example] opt does not depend on Titans (#1811)
2 years ago
Jiarui Fang 203ca57aed
[example] add GPT
2 years ago
Jiarui Fang fd2c8d8156
[example] add opt model in lauguage (#1809)
2 years ago
Jiarui Fang f5a92c288c
[example] add diffusion to example (#1805)
2 years ago
Jiarui Fang a19eb80998
[embedding] updates some default parameters
2 years ago
github-actions[bot] 177d3f5718
Automated submodule synchronization (#1465)
2 years ago
github-actions[bot] 9b442ecdc3
Automated submodule synchronization (#1404)
2 years ago
github-actions[bot] 1e5eb0874c
Automated submodule synchronization (#1396)
2 years ago
github-actions[bot] 50dec605e1
Automated submodule synchronization (#1380)
2 years ago
github-actions[bot] fb6f085907
Automated submodule synchronization (#1372)
2 years ago
github-actions[bot] 6160a1d6a7
Automated submodule synchronization (#1348)
2 years ago