354 Commits (73aa406b966b3dadf20aaeef7e3c0c3e5937eeb9)

Author	SHA1	Message	Date
Hongxin Liu	f83ea813f5	[example] add train resnet/vit with booster example (#3694) ... * [example] add train vit with booster example * [example] update readme * [example] add train resnet with booster example * [example] enable ci * [example] enable ci * [example] add requirements * [hotfix] fix analyzer init * [example] update requirements	2 years ago
Hongxin Liu	d556648885	[example] add finetune bert with booster example (#3693)	2 years ago
digger-yu	b9a8dff7e5	[doc] Fix typo under colossalai and doc(#3618) ... * Fixed several spelling errors under colossalai * Fix the spelling error in colossalai and docs directory * Cautious Changed the spelling error under the example folder * Update runtime_preparation_pass.py revert autograft to autograd * Update search_chunk.py utile to until * Update check_installation.py change misteach to mismatch in line 91 * Update 1D_tensor_parallel.md revert to perceptron * Update 2D_tensor_parallel.md revert to perceptron in line 73 * Update 2p5D_tensor_parallel.md revert to perceptron in line 71 * Update 3D_tensor_parallel.md revert to perceptron in line 80 * Update README.md revert to resnet in line 42 * Update reorder_graph.py revert to indice in line 7 * Update p2p.py revert to megatron in line 94 * Update initialize.py revert to torchrun in line 198 * Update routers.py change to detailed in line 63 * Update routers.py change to detailed in line 146 * Update README.md revert random number in line 402	2 years ago
github-actions[bot]	d544ed4345	[bot] Automated submodule synchronization (#3596) ... Co-authored-by: github-actions <github-actions@github.com>	2 years ago
digger-yu	d0fbd4b86f	[example] fix community doc (#3586) ... Adjusted the style of Community Examples to be consistent with other titles	2 years ago
binmakeswell	f1b3d60cae	[example] reorganize for community examples (#3557)	2 years ago
natalie_cao	de84c0311a	Polish Code	2 years ago
binmakeswell	0c0455700f	[doc] add requirement and highlight application (#3516) ... * [doc] add requirement and highlight application * [doc] link example and application	2 years ago
mandoxzhang	8f2c55f9c9	[example] remove redundant texts & update roberta (#3493) ... * update roberta example * update roberta example * modify conflict & update roberta	2 years ago
mandoxzhang	ab5fd127e3	[example] update roberta with newer ColossalAI (#3472) ... * update roberta example * update roberta example	2 years ago
NatalieC323	fb8fae6f29	Revert "[dreambooth] fixing the incompatibity in requirements.txt (#3190) (#3378)" (#3481)	2 years ago
NatalieC323	c701b77b11	[dreambooth] fixing the incompatibity in requirements.txt (#3190) (#3378) ... * Update requirements.txt * Update environment.yaml * Update README.md * Update environment.yaml * Update README.md * Update README.md * Delete requirements_colossalai.txt * Update requirements.txt * Update README.md	2 years ago
Frank Lee	80eba05b0a	[test] refactor tests with spawn (#3452) ... * [test] added spawn decorator * polish code * polish code * polish code * polish code * polish code * polish code	2 years ago
Frank Lee	7d8d825681	[booster] fixed the torch ddp plugin with the new checkpoint api (#3442)	2 years ago
ver217	573af84184	[example] update examples related to zero/gemini (#3431) ... * [zero] update legacy import * [zero] update examples * [example] fix opt tutorial * [example] fix opt tutorial * [example] fix opt tutorial * [example] fix opt tutorial * [example] fix import	2 years ago
ver217	26b7aac0be	[zero] reorganize zero/gemini folder structure (#3424) ... * [zero] refactor low-level zero folder structure * [zero] fix legacy zero import path * [zero] fix legacy zero import path * [zero] remove useless import * [zero] refactor gemini folder structure * [zero] refactor gemini folder structure * [zero] refactor legacy zero import path * [zero] refactor gemini folder structure * [zero] refactor gemini folder structure * [zero] refactor gemini folder structure * [zero] refactor legacy zero import path * [zero] fix test import path * [zero] fix test * [zero] fix circular import * [zero] update import	2 years ago
Jan Roudaut	dd367ce795	[doc] polish diffusion example (#3386) ... * [examples/images/diffusion]: README.md: typo fixes * Update README.md * Grammar fixes * Reformulated "Step 3" (xformers) introduction to the cost => at the cost + reworded pip availability.	2 years ago
Jan Roudaut	51cd2fec57	Typofix: malformed `xformers` version (#3384) ... s/0.12.0/0.0.12/	2 years ago
YuliangLiu0306	fd6add575d	[examples] polish AutoParallel readme (#3270)	2 years ago
Frank Lee	73d3e4d309	[booster] implemented the torch ddd + resnet example (#3232) ... * [booster] implemented the torch ddd + resnet example * polish code	2 years ago
NatalieC323	280fcdc485	polish code (#3194) ... Co-authored-by: YuliangLiu0306 <72588413+YuliangLiu0306@users.noreply.github.com>	2 years ago
Yan Fang	189347963a	[auto] fix requirements typo for issue #3125 (#3209)	2 years ago
NatalieC323	e5f668f280	[dreambooth] fixing the incompatibity in requirements.txt (#3190) ... * Update requirements.txt * Update environment.yaml * Update README.md * Update environment.yaml * Update README.md * Update README.md * Delete requirements_colossalai.txt * Update requirements.txt * Update README.md	2 years ago
Zihao	18dbe76cae	[auto-parallel] add auto-offload feature (#3154) ... * add auto-offload feature * polish code * fix syn offload runtime pass bug * add offload example * fix offload testing bug * fix example testing bug	2 years ago
NatalieC323	4e921cfbd6	[examples] Solving the diffusion issue of incompatibility issue#3169 (#3170) ... * Update requirements.txt * Update environment.yaml * Update README.md * Update environment.yaml	2 years ago
binmakeswell	3c01280a56	[doc] add community contribution guide (#3153) ... * [doc] update contribution guide * [doc] update contribution guide * [doc] add community contribution guide	2 years ago
github-actions[bot]	0aa92c0409	Automated submodule synchronization (#3105) ... Co-authored-by: github-actions <github-actions@github.com>	2 years ago
binmakeswell	018936a3f3	[tutorial] update notes for TransformerEngine (#3098)	2 years ago
Kirthi Shankar Sivamani	65a4dbda6c	[NVIDIA] Add FP8 example using TE (#3080) ... Signed-off-by: Kirthi Shankar Sivamani <ksivamani@nvidia.com>	2 years ago
Fazzie-Maqianli	5d5f475d75	[diffusers] fix ci and docker (#3085)	2 years ago
Camille Zhong	e58a3c804c	Fix the version of lightning and colossalai in Stable Diffusion environment requirement (#3073) ... 1. Modify the README of stable diffusion 2. Fix the version of pytorch lightning&lightning and colossalai version to enable codes running successfully.	2 years ago
binmakeswell	360674283d	[example] fix redundant note (#3065)	2 years ago
Tomek	af3888481d	[example] fixed opt model downloading from huggingface	2 years ago
ramos	2ef855c798	support shardinit option to avoid OPT OOM initializing problem (#3037) ... Co-authored-by: poe <poe@nemoramo>	2 years ago
Ziyue Jiang	400f63012e	[pipeline] Add Simplified Alpa DP Partition (#2507) ... * add alpa dp split * add alpa dp split * use fwd+bwd instead of fwd only --------- Co-authored-by: Ziyue Jiang <ziyue.jiang@gmail.com>	2 years ago
binmakeswell	52a5078988	[doc] add ISC tutorial (#2997) ... * [doc] add ISC tutorial * [doc] add ISC tutorial * [doc] add ISC tutorial * [doc] add ISC tutorial	2 years ago
github-actions[bot]	827a0af8cc	Automated submodule synchronization (#2982) ... Co-authored-by: github-actions <github-actions@github.com>	2 years ago
github-actions[bot]	da056285f2	[format] applied code formatting on changed files in pull request 2922 (#2923) ... Co-authored-by: github-actions <github-actions@github.com>	2 years ago
binmakeswell	12bafe057f	[doc] update installation for GPT (#2922)	2 years ago
binmakeswell	0afb55fc5b	[doc] add os scope, update tutorial install and tips (#2914)	2 years ago
Alex_996	a4fc125c34	Fix typos (#2863) ... Fix typos, `6.7 -> 6.7b`	2 years ago
dawei-wang	55424a16a5	[doc] fix GPT tutorial (#2860) ... Fix hpcaitech/ColossalAI#2851	2 years ago
Zheng Zeng	597914317b	[doc] fix typo in opt inference tutorial (#2849)	2 years ago
github-actions[bot]	a5721229d9	Automated submodule synchronization (#2740) ... Co-authored-by: github-actions <github-actions@github.com>	2 years ago
Haofan Wang	47ecb22387	[example] add LoRA support (#2821) ... * add lora * format	2 years ago
Jiarui Fang	bf0204604f	[exmaple] add bert and albert (#2824)	2 years ago
Fazzie-Maqianli	ba84cd80b2	fix pip install colossal (#2764)	2 years ago
cloudhuang	43dffdaba5	[doc] fixed a typo in GPT readme (#2736)	2 years ago
Fazzie-Maqianli	d03f4429c1	add ci (#2641)	2 years ago
github-actions[bot]	d701ef81b1	Automated submodule synchronization (#2707) ... Co-authored-by: github-actions <github-actions@github.com>	2 years ago
github-actions[bot]	88416019e7	Automated submodule synchronization (#2648) ... Co-authored-by: github-actions <github-actions@github.com>	2 years ago
binmakeswell	9ab14b20b5	[doc] add CVPR tutorial (#2666)	2 years ago
Jiatong (Julius) Han	a255a38f7f	[example] Polish README.md (#2658) ... * [tutorial] polish readme.md * [example] Update README.md	2 years ago
Fazzie-Maqianli	292c81ed7c	fix/transformer-verison (#2581)	2 years ago
Frank Lee	4ae02c4b1c	[tutorial] added energonai to opt inference requirements (#2625)	2 years ago
binmakeswell	0556f5d468	[tutorial] add video link (#2619)	2 years ago
github-actions[bot]	ae86be1fd2	Automated submodule synchronization (#2607) ... Co-authored-by: github-actions <github-actions@github.com>	2 years ago
binmakeswell	039b0c487b	[tutorial] polish README (#2568)	2 years ago
oahzxl	4f5ef73a43	[tutorial] update fastfold tutorial (#2565) ... * update readme * update * update	2 years ago
Fazzie-Maqianli	79079a9d0c	Merge pull request #2561 from Fazziekey/v2 ... bug/fix diffusion ckpt problem	2 years ago
Fazzie	cad1f50512	fix ckpt	2 years ago
YuliangLiu0306	f477a14f4a	[hotfix] fix autoparallel demo (#2533)	2 years ago
HELSON	6e0faa70e0	[gemini] add profiler in the demo (#2534)	2 years ago
Fazzie	f35326881c	fix README	2 years ago
HELSON	66dfcf5281	[gemini] update the gpt example (#2527)	2 years ago
LuGY	ecbad93b65	[example] Add fastfold tutorial (#2528) ... * add fastfold example * pre-commit polish * pre-commit polish readme and add empty test ci * Add test_ci and reduce the default sequence length	2 years ago
Jiarui Fang	fd8d19a6e7	[example] update lightning dependency for stable diffusion (#2522)	2 years ago
HELSON	707b11d4a0	[gemini] update ddp strict mode (#2518) ... * [zero] add strict ddp mode for chunk init * [gemini] update gpt example	2 years ago
HELSON	2d1a7dfe5f	[zero] add strict ddp mode (#2508) ... * [zero] add strict ddp mode * [polish] add comments for strict ddp mode * [zero] fix test error	2 years ago
jiaruifang	32390cbe8f	add test_ci.sh to dreambooth	2 years ago
jiaruifang	025b482dc1	[example] dreambooth example	2 years ago
jiaruifang	e58cc441e2	polish code and fix dataloader bugs	2 years ago
jiaruifang	a4b75b78a0	[hotfix] gpt example titans bug #2493	2 years ago
binmakeswell	fcc6d61d92	[example] fix requirements (#2488)	2 years ago
Jiarui Fang	3a21485ead	[example] titans for gpt (#2484)	2 years ago
Jiarui Fang	7c31706227	[CI] add test_ci.sh for palm, opt and gpt (#2475)	2 years ago
Jiarui Fang	e4c38ba367	[example] stable diffusion add roadmap (#2482)	2 years ago
ver217	f525d1f528	[example] update gpt gemini example ci test (#2477)	2 years ago
Ziyue Jiang	fef5c949c3	polish pp middleware (#2476) ... Co-authored-by: Ziyue Jiang <ziyue.jiang@gmail.com>	2 years ago
Frank Lee	8b7495dd54	[example] integrate seq-parallel tutorial with CI (#2463)	2 years ago
ver217	8e85d2440a	[example] update vit ci script (#2469) ... * [example] update vit ci script * [example] update requirements * [example] update requirements	2 years ago
Jiarui Fang	867c8c2d3a	[zero] low level optim supports ProcessGroup (#2464)	2 years ago
Frank Lee	e6943e2d11	[example] integrate autoparallel demo with CI (#2466) ... * [example] integrate autoparallel demo with CI * polish code * polish code * polish code * polish code	2 years ago
YuliangLiu0306	c20529fe78	[examples] update autoparallel tutorial demo (#2449) ... * [examples] update autoparallel tutorial demo * add test_ci.sh * polish * add conda yaml	2 years ago
Haofan Wang	cfd1d5ee49	[example] fixed seed error in train_dreambooth_colossalai.py (#2445)	2 years ago
Frank Lee	ac18a445fa	[example] updated large-batch optimizer tutorial (#2448) ... * [example] updated large-batch optimizer tutorial * polish code * polish code	2 years ago
Frank Lee	39163417a1	[example] updated the hybrid parallel tutorial (#2444) ... * [example] updated the hybrid parallel tutorial * polish code	2 years ago
YuliangLiu0306	2731531bc2	[autoparallel] integrate device mesh initialization into autoparallelize (#2393) ... * [autoparallel] integrate device mesh initialization into autoparallelize * add megatron solution * update gpt autoparallel examples with latest api * adapt beta value to fit the current computation cost	2 years ago
Frank Lee	a3e5496156	[example] improved the clarity yof the example readme (#2427) ... * [example] improved the clarity yof the example readme * polish workflow * polish workflow * polish workflow * polish workflow * polish workflow * polish workflow	2 years ago
Frank Lee	63be79d505	[example] removed duplicated stable diffusion example (#2424)	2 years ago
ZijianYY	fe0f7970a2	[examples] adding tflops to PaLM (#2365)	2 years ago
HELSON	d84e747975	[hotfix] add DISTPAN argument for benchmark (#2412) ... * change the benchmark config file * change config * revert config file * rename distpan to distplan	2 years ago
Frank Lee	8327932d2c	[workflow] refactored the example check workflow (#2411) ... * [workflow] refactored the example check workflow * polish code * polish code * polish code * polish code * polish code * polish code * polish code * polish code * polish code * polish code * polish code	2 years ago
HELSON	498b5ca993	[hotfix] fix gpt gemini example (#2404) ... * [hotfix] fix gpt gemini example * [example] add new assertions	2 years ago
jiaruifang	b2e0d502b8	[doc] hotfix #2377	2 years ago
Jiarui Fang	8f72b6f8fb	[hotfix] fix implement error in diffusers	2 years ago
1SAA	33f3023e19	[hotfix] fix implement error in diffusers	2 years ago
Jiarui Fang	12c8bf38d7	[Pipeline] Refine GPT PP Example	2 years ago
Ziyue Jiang	ad00894f7f	polish	2 years ago
Jiarui Fang	1aaeb596c6	[example] gpt, shard init on all processes (#2366)	2 years ago
Ziyue Jiang	3a15b20421	Move GPT PP Example	2 years ago
HELSON	48d33b1b17	[gemini] add get static torch model (#2356)	2 years ago
Fazzie-Maqianli	7a332b1734	Merge pull request #2338 from haofanwang/patch-1 ... Fix a typo in train_dreambooth_colossalai.py	2 years ago
YuliangLiu0306	8b1e0dfd80	[example] upload auto parallel gpt2 demo (#2354)	2 years ago
Jiarui Fang	00a9c781fd	[example] add google doc for benchmark results of GPT (#2355)	2 years ago
Jiarui Fang	509a87f3ff	[example] make gpt example directory more clear (#2353)	2 years ago
Ikko Eltociear Ashimine	5e4bced0a3	[NFC] Update roberta/README.md (#2350)	2 years ago
Jiarui Fang	35e22be2f6	[example] simplify opt example (#2344)	2 years ago
ziyuhuang123	7080a8edb0	[workflow]New version: Create workflow files for examples' auto check (#2298) ... * [workflows]bug_repair * [workflow]new_pr_fixing_bugs Co-authored-by: binmakeswell <binmakeswell@gmail.com>	2 years ago
binmakeswell	d7352bef2c	[example] add example requirement (#2345)	2 years ago
Haofan Wang	7ce965c7cc	Update requirement_colossalai.txt (#2348)	2 years ago
ZijianYY	f7fd592bf4	[examples]adding tp to PaLM (#2319)	2 years ago
Haofan Wang	9edd0aa75e	Update train_dreambooth_colossalai.py ... accelerator.num_processes -> gpc.get_world_size(ParallelMode.DATA)	2 years ago
Fazzie-Maqianli	89f26331e9	[example] diffusion update diffusion,Dreamblooth (#2329)	2 years ago
binmakeswell	e512ca9c24	[doc] update stable diffusion link (#2322) ... * [doc] update link	2 years ago
Fazzie-Maqianli	a9b27b9265	[exmaple] fix dreamblooth format (#2315)	2 years ago
Jiarui Fang	32253315b4	[example] update diffusion readme with official lightning (#2304)	2 years ago
HELSON	e00cedd181	[example] update gemini benchmark bash (#2306)	2 years ago
binmakeswell	c8144223b8	[doc] update diffusion doc (#2296)	2 years ago
ZijianYY	df1d6dc553	[examples] using args and combining two versions for PaLM (#2284)	2 years ago
Ziyue Jiang	ac863a01d6	[example] add benchmark (#2276) ... * add benchmark * merge common func * add total and avg tflops Co-authored-by: Ziyue Jiang <ziyue.jiang@gmail.com>	2 years ago
BlueRum	1405b4381e	[example] fix save_load bug for dreambooth (#2280)	2 years ago
Jiarui Fang	879df8b943	[example] GPT polish readme (#2274)	2 years ago
Ziyue Jiang	9654df0e9a	Add GPT PP Example (#2272) ... Co-authored-by: Ziyue Jiang <ziyue.jiang@gmail.com>	2 years ago
YuliangLiu0306	4b29112ab2	[autoparallel] gpt2 autoparallel examples (#2267) ... * [autoparallel] gpt2 autoparallel examples * polish code * polish code	2 years ago
HELSON	09c0102fe6	[example] fix gpt example with 0.1.10 (#2265)	2 years ago
Fazzie-Maqianli	89f048a88a	[example] clear diffuser image (#2262)	2 years ago
Frank Lee	89542ceb44	[doc] updated the stable diffussion on docker usage (#2244) ... * [doc] updated the stable diffussion on docker usage * polish doc	2 years ago
Jiarui Fang	50cdf5430e	[example] diffusion install from docker (#2239) ... * [builder] builder for scaled_upper_triang_masked_softmax * add missing files * fix a bug * polish code * [example] diffusion install from docker	2 years ago
Jiarui Fang	db4cbdc7fb	[builder] builder for scaled_upper_triang_masked_softmax (#2234)	2 years ago
HELSON	31fe84237b	[example] fix benchmark.sh for gpt example (#2229)	2 years ago
Jiarui Fang	2cdecc9f38	[example] make palm + GeminiDPP work (#2227)	2 years ago
ZijianYY	63cc77173b	[example] Palm adding gemini, still has bugs (#2221)	2 years ago
HELSON	7010e18134	[example] update gpt example (#2225)	2 years ago
Jiarui Fang	49c601da21	[example] add benchmark.sh for gpt (#2226)	2 years ago
HELSON	3629e611cd	[example] update gpt benchmark (#2219)	2 years ago
ZijianYY	92de90dfb3	[examples] replace einsum with matmul (#2210)	2 years ago
Jiarui Fang	7675792100	[builder] raise Error when CUDA_HOME is not set (#2213)	2 years ago
HELSON	78a89d9b41	[diffusion] update readme (#2214)	2 years ago
Jiarui Fang	d96cc37e32	[example] update GPT example benchmark results (#2212)	2 years ago
Jiarui Fang	d5e3e3ec01	[example] update gpt example for larger model scale (#2211)	2 years ago
Jiarui Fang	29868a9ec1	[example] update gpt readme with performance (#2206)	2 years ago
BlueRum	6642cebdbe	[example] Change some training settings for diffusion (#2195)	2 years ago
ziyuhuang123	4363ff3e41	'[NFC] fix some typos' (#2175)	2 years ago
Fazzie-Maqianli	ce3c4eca7b	[example] support Dreamblooth (#2188)	2 years ago
BlueRum	1cf6d92d7c	[exmaple] diffuser, support quant inference for stable diffusion (#2186)	2 years ago
Jiarui Fang	65f56f49e8	[example] gpt demo more accuracy tflops (#2178)	2 years ago
ziyuhuang123	cf5028363c	'diffusion-typo-change'	2 years ago
Jiarui Fang	27327a4c90	[example] add palm pytorch version (#2172)	2 years ago
Jiarui Fang	a4b4bb01d6	[example] update vit readme (#2155)	2 years ago