ColossalAI

Commit Graph

Author	SHA1	Message	Date
binmakeswell	9885ec2b2e	[git] remove invalid submodule (#2540 )	2 years ago
oahzxl	05671fcb42	[autochunk] support multi outputs chunk search (#2538 ) Support multi outputs chunk search. Previously we only support single output chunk search. It is more flexible and improve performance by a large margin. For transformer, we reduce memory by 40% than previous search strategy. 1. rewrite search strategy to support multi outputs chunk search 2. fix many, many bugs 3. update tests	2 years ago
YuliangLiu0306	f477a14f4a	[hotfix] fix autoparallel demo (#2533 )	2 years ago
oahzxl	63199c6687	[autochunk] support transformer (#2526 )	2 years ago
HELSON	6e0faa70e0	[gemini] add profiler in the demo (#2534 )	2 years ago
Fazzie-Maqianli	df437ca039	Merge pull request #2532 from Fazziekey/fix fix README	2 years ago
Fazzie	f35326881c	fix README	2 years ago
HELSON	a4ed9125ac	[hotfix] fix lightning error (#2529 )	2 years ago
Frank Lee	b55deb0662	[workflow] only report coverage for changed files (#2524 ) * [workflow] only report coverage for changed files * polish file * polish file * polish file * polish file * polish file * polish file * polish file * polish file * polish file * polish file * polish file * polish file * polish file * polish file * polish file * polish file * polish file * polish file * polish file * polish file * polish file * polish file	2 years ago
HELSON	66dfcf5281	[gemini] update the gpt example (#2527 )	2 years ago
LuGY	ecbad93b65	[example] Add fastfold tutorial (#2528 ) * add fastfold example * pre-commit polish * pre-commit polish readme and add empty test ci * Add test_ci and reduce the default sequence length	2 years ago
Frank Lee	af151032f2	[workflow] fixed the precommit CI (#2525 ) * [workflow] fixed the precommit CI * polish file * polish file	2 years ago
HELSON	b528eea0f0	[zero] add zero wrappers (#2523 ) * [zero] add zero wrappers * change names * add wrapper functions to init	2 years ago
Super Daniel	c198c7c0b0	[hotfix] meta tensor default device. (#2510 )	2 years ago
HELSON	077a5cdde4	[zero] fix gradient clipping in hybrid parallelism (#2521 ) * [zero] fix gradient clipping in hybrid parallelism * [testing] change model name to avoid pytest warning * [hotfix] fix unit testing	2 years ago
Jiarui Fang	fd8d19a6e7	[example] update lightning dependency for stable diffusion (#2522 )	2 years ago
YuliangLiu0306	aa0f6686f9	[autoparallel] accelerate gpt2 training (#2495 )	2 years ago
binmakeswell	a360b9bc44	[doc] update example link (#2520 ) * [doc] update example link * [doc] update example link	2 years ago
HELSON	707b11d4a0	[gemini] update ddp strict mode (#2518 ) * [zero] add strict ddp mode for chunk init * [gemini] update gpt example	2 years ago
Frank Lee	0af793836c	[workflow] fixed changed file detection (#2515 )	2 years ago
binmakeswell	a6a10616ec	[doc] update opt and tutorial links (#2509 )	2 years ago
HELSON	2d1a7dfe5f	[zero] add strict ddp mode (#2508 ) * [zero] add strict ddp mode * [polish] add comments for strict ddp mode * [zero] fix test error	2 years ago
oahzxl	c04f183237	[autochunk] support parsing blocks (#2506 )	2 years ago
Super Daniel	35c0c0006e	[utils] lazy init. (#2148 ) * [utils] lazy init. * [utils] remove description. * [utils] complete. * [utils] finalize. * [utils] fix names.	2 years ago
oahzxl	72341e65f4	[auto-chunk] support extramsa (#3 ) (#2504 )	2 years ago
Ziyue Jiang	0f02b8c6e6	add avg partition (#2483 ) Co-authored-by: Ziyue Jiang <ziyue.jiang@gmail.com>	2 years ago
アマデウス	99d9713b02	Revert "Update parallel_context.py (#2408 )" This reverts commit `7d5640b9db`.	2 years ago
oahzxl	ecccc91f21	[autochunk] support autochunk on evoformer (#2497 )	2 years ago
Fazzie-Maqianli	304f1ba124	Merge pull request #2499 from feifeibear/dev0116_10 [example] check dreambooth example gradient accmulation must be 1	2 years ago
jiaruifang	32390cbe8f	add test_ci.sh to dreambooth	2 years ago
jiaruifang	7f822a5c45	Merge branch 'main' of https://github.com/hpcaitech/ColossalAI into dev0116	2 years ago
jiaruifang	025b482dc1	[example] dreambooth example	2 years ago
oahzxl	5db3a5bf42	[fx] allow control of ckpt_codegen init (#2498 ) * [fx] allow control of ckpt_codegen init Currently in ColoGraphModule, ActivationCheckpointCodeGen will be set automatically in __init__. But other codegen can't be set if so. So I add an arg to control whether to set ActivationCheckpointCodeGen in __init__. * code style	2 years ago
Jiarui Fang	e327e95144	[hotfix] gpt example titans bug #2493 (#2494 )	2 years ago
jiaruifang	e58cc441e2	polish code and fix dataloader bugs	2 years ago
jiaruifang	a4b75b78a0	[hotfix] gpt example titans bug #2493	2 years ago
jiaruifang	8208fd023a	Merge branch 'main' of https://github.com/hpcaitech/ColossalAI into dev0116	2 years ago
HELSON	d565a24849	[zero] add unit testings for hybrid parallelism (#2486 )	2 years ago
binmakeswell	fcc6d61d92	[example] fix requirements (#2488 )	2 years ago
oahzxl	4953b4ace1	[autochunk] support evoformer tracer (#2485 ) support full evoformer tracer, which is a main module of alphafold. previously we just support a simplifed version of it. 1. support some evoformer's op in fx 2. support evoformer test 3. add repos for test code	2 years ago
YuliangLiu0306	67e1912b59	[autoparallel] support origin activation ckpt on autoprallel system (#2468 )	2 years ago
Jiarui Fang	3a21485ead	[example] titans for gpt (#2484 )	2 years ago
jiaruifang	438ea608f3	update readme	2 years ago
jiaruifang	38424db6ff	polish code	2 years ago
jiaruifang	92f65fbbe3	remove license	2 years ago
jiaruifang	315e1433ce	polish readme	2 years ago
jiaruifang	37baea20cb	[example] titans for gpt	2 years ago
jiaruifang	236b4195ff	Merge branch 'main' of https://github.com/hpcaitech/ColossalAI into dev0116	2 years ago
jiaruifang	e64a05b38b	polish code	2 years ago
Jiarui Fang	7c31706227	[CI] add test_ci.sh for palm, opt and gpt (#2475 )	2 years ago

1 2 3 4 5 ...

1877 Commits (9885ec2b2e1fa6b52f80157c09775558baae4254) All Branches Search

1877 Commits (9885ec2b2e1fa6b52f80157c09775558baae4254)

All Branches