ColossalAI

Commit Graph

Author	SHA1	Message	Date
Boyuan Yao	cfe2a9bd90	[autoparallel] memory estimation for shape consistency (#2144 ) * [fx] metainfo class for auto parallel * [fx] add unit test for linear metainfo * [fx] fix bwd param for linear * [fx] modify unit test * [fx] modify unit test * [fx] modify import * [fx] modify import * [fx] modify import * [fx] move meta profiler to auto parallel * [fx] add conv metainfo class * [fx] restore profiler * [fx] restore meta profiler * [autoparallel] modify unit test * [fx] modify unit test * [autoparallel] add batchnorm metainfo class * [autoparallel] fix batchnorm unit test function declaration * [fx] restore profiler * [fx] add relu metainfo class * [fx] restore profiler * [autoparallel] modify metainfo input * [autoparallel] add pooling metainfo * [autoparallel] add F.linear metainfo generator * [autoparallel] add binary elementwise metainfo * [fx] recover profiler * [autoparallel] fix forward memory calculation * [autoparallel] modify constants.py * [autoparallel] remove redundant print * [autoparallel] add F.conv metainfo * [autoparallel] linear fix * [autoparallel] memory estimation for communication actions * [autoparallel] fix docstring * [autoparallel] fix variables name	2 years ago
Jiarui Fang	b87496a66b	[hotfix] fix auto policy of test_sharded_optim_v2 (#2157 )	2 years ago
YuliangLiu0306	16335cb537	[hotfix] fix aten default bug (#2158 )	2 years ago
Jiarui Fang	a4b4bb01d6	[example] update vit readme (#2155 )	2 years ago
Jiarui Fang	2cfe685b9f	[exmaple] add vit missing functions (#2154 )	2 years ago
HELSON	a7d95b7024	[example] add zero1, zero2 example in GPT examples (#2146 ) * [example] add zero1 and zero2 for GPT * update readme in gpt example * polish code * change init value * update readme	2 years ago
YuliangLiu0306	1cce6e36ca	[autoparallel] use metainfo in handler (#2149 )	2 years ago
Jiarui Fang	9b39170a5c	[version] 0.1.13 (#2152 )	2 years ago
Jiarui Fang	e0c01d1db1	Revert "[version] version to v0.1.13 (#2139 )" (#2153 ) This reverts commit `6ad866b684`.	2 years ago
Jiarui Fang	2827f41898	[Gemini] GeminiDPP convert to PyTorch Module. (#2151 )	2 years ago
Jiarui Fang	bdef9dfdbe	[NFC] remove useless graph node code (#2150 )	2 years ago
BlueRum	b3f73ce1c8	[Gemini] Update coloinit_ctx to support meta_tensor (#2147 )	2 years ago
Jiarui Fang	6ad866b684	[version] version to v0.1.13 (#2139 )	2 years ago
Zihao	a128eec9d5	register aten._convolution.default (#2137 )	2 years ago
Jiarui Fang	ee287620f0	[Gemini] revert ZeROInitCtx related tracer (#2138 )	2 years ago
アマデウス	077a66dd81	updated attention kernel (#2133 )	2 years ago
github-actions[bot]	484fe62252	Automated submodule synchronization (#2131 ) Co-authored-by: github-actions <github-actions@github.com>	2 years ago
YuliangLiu0306	a3c6924deb	[autoparallel] process size nodes in runtime pass (#2130 ) * [autoparallel] process size nodes in runtime pass * polish code	2 years ago
YuliangLiu0306	536560ccc0	[autoparallel] implement softmax handler (#2132 )	2 years ago
Jiarui Fang	c89c66a858	[Gemini] update API of the chunkmemstatscollector. (#2129 )	2 years ago
Jiarui Fang	2938edf446	[Gemini] update the non model data record method in runtime memory tracer (#2128 )	2 years ago
Jiarui Fang	deee317b0f	[Gemini] test step-tensor mapping using repeated_computed_layers.py (#2127 )	2 years ago
Jiarui Fang	8fac837679	[Gemini] update non model data calculation method (#2126 )	2 years ago
Fazzie-Maqianli	6c4c6a0409	Merge pull request #2120 from Fazziekey/example/stablediffusion-v2 [example] support stable diffusion v2	2 years ago
Fazzie	cea4292ae5	support stable diffusion v2	2 years ago
Jiarui Fang	5efda69735	[Gemini] hotfix the unittest bugs (#2125 )	2 years ago
Jiarui Fang	05bb28aacf	[Gemini] mapping of preop timestep and param (#2124 )	2 years ago
github-actions[bot]	764bc16f3e	Automated submodule synchronization (#2123 ) Co-authored-by: github-actions <github-actions@github.com>	2 years ago
YuliangLiu0306	cd0af9f7f6	[autoparallel] gpt2lp runtimee test (#2113 )	2 years ago
Jiarui Fang	9214d1fe28	[Gemini] chunk init using runtime visited param order (#2115 )	2 years ago
HELSON	e7d3afc9cc	[optimizer] add div_scale for optimizers (#2117 ) * [optimizer] add div_scale for optimizers * [zero] use div_scale in zero optimizer * fix testing error	2 years ago
Jiarui Fang	e5aa8333e4	[NFC] update chunk manager API (#2119 )	2 years ago
Jiarui Fang	e99edfcb51	[NFC] polish comments for Chunk class (#2116 )	2 years ago
Ziyue Jiang	09d69e1c25	[PP Middleware] Add bwd and step for PP middleware (#2111 ) * add bwd and step for PP middleware * pre-commit Co-authored-by: Ziyue Jiang <ziyue.jiang@gmail.com>	2 years ago
Jiarui Fang	8afc001f4f	[Gemini] chunk init use OrderedParamGenerator (#2110 )	2 years ago
HELSON	63fbba3c19	[zero] add L2 gradient clipping for ZeRO (#2112 ) * [zero] add L2 gradient clipping * [testing] add MlpModel * [zero] add unit test for grad clipping * fix atol	2 years ago
Jiarui Fang	70a8556946	[gemini] get the param visited order during runtime (#2108 )	2 years ago
Jiarui Fang	61f31c3cf0	[Gemini] NFC, polish search_chunk_configuration (#2107 )	2 years ago
Jiarui Fang	8e14344ec9	[hotfix] fix a type in ColoInitContext (#2106 )	2 years ago
Jiarui Fang	05545bfee9	[ColoTensor] throw error when ColoInitContext meets meta parameter. (#2105 )	2 years ago
YuliangLiu0306	d87baa85d9	[autoparallel] support linear function bias addition (#2104 )	2 years ago
Jiarui Fang	6a71d3a0d9	[version] 0.1.11rc5 -> 0.1.12 (#2103 )	2 years ago
YuliangLiu0306	0fecbb9e20	[autoparallel] support addbmm computation (#2102 )	2 years ago
YuliangLiu0306	d3d4630495	[autoparallel] add sum handler (#2101 )	2 years ago
Ziyue Jiang	e4705ba4e2	[Pipeline Middleware] fix data race in Pipeline Scheduler for DAG (#2087 ) * add DAG test case * fix datarace by adjusting theposition of lock * polish code * fix pytest for middleware * remove test Co-authored-by: Ziyue Jiang <ziyue.jiang@gmail.com>	2 years ago
YuliangLiu0306	b175e6d58e	[autoparallel] add bias addtion function class (#2098 ) * [autoparallel] add bias addtion function class * polish code * polish	2 years ago
YuliangLiu0306	3af7e65dea	[autoparallel] complete gpt related module search (#2097 )	2 years ago
Jiarui Fang	85efb7ac2e	[Gemini] gemini use the runtime memory tracer (RMT) (#2099 )	2 years ago
Super Daniel	2bf2d1cd3b	[fx] An experimental version of ColoTracer.' (#2002 ) * [fx] add a symbolic_trace api. * [fx] fix import errors. * [fx] ColoTracer experimental.	2 years ago
Jiarui Fang	4b055351b0	[Gemini] make RuntimeMemTracer work correctly (#2096 )	2 years ago

1 2 3 4 5 ...

1591 Commits (da1c47f0603c51d1aeabd64f52b14d2c8b84b2b0) All Branches Search

1591 Commits (da1c47f0603c51d1aeabd64f52b14d2c8b84b2b0)

All Branches