1948 Commits (b3d10db5f1bc58f79e6eeb010b76612aeb299730)

 

All Branches   

Search

Author	SHA1	Message	Date
oahzxl	98f9728e29	code style	2 years ago
YuliangLiu0306	cd0af9f7f6	[autoparallel] gpt2lp runtimee test (#2113)	2 years ago
Jiarui Fang	9214d1fe28	[Gemini] chunk init using runtime visited param order (#2115)	2 years ago
HELSON	e7d3afc9cc	[optimizer] add div_scale for optimizers (#2117) ... * [optimizer] add div_scale for optimizers * [zero] use div_scale in zero optimizer * fix testing error	2 years ago
oahzxl	8511d900a8	code style	2 years ago
oahzxl	5cdfcfe1d1	code style	2 years ago
oahzxl	b7b67c32ad	code style	2 years ago
oahzxl	31a2c5d09f	work with outerproductmean and msa	2 years ago
Jiarui Fang	e5aa8333e4	[NFC] update chunk manager API (#2119)	2 years ago
Jiarui Fang	e99edfcb51	[NFC] polish comments for Chunk class (#2116)	2 years ago
Ziyue Jiang	09d69e1c25	[PP Middleware] Add bwd and step for PP middleware (#2111) ... * add bwd and step for PP middleware * pre-commit Co-authored-by: Ziyue Jiang <ziyue.jiang@gmail.com>	2 years ago
Jiarui Fang	8afc001f4f	[Gemini] chunk init use OrderedParamGenerator (#2110)	2 years ago
oahzxl	5de9e46381	code format	2 years ago
oahzxl	d31e146687	code format	2 years ago
oahzxl	929445116a	pass outproduct mean	2 years ago
HELSON	63fbba3c19	[zero] add L2 gradient clipping for ZeRO (#2112) ... * [zero] add L2 gradient clipping * [testing] add MlpModel * [zero] add unit test for grad clipping * fix atol	2 years ago
oahzxl	979e61db92	redesign index tracer, add source and change compute	2 years ago
Jiarui Fang	70a8556946	[gemini] get the param visited order during runtime (#2108)	2 years ago
Jiarui Fang	61f31c3cf0	[Gemini] NFC, polish search_chunk_configuration (#2107)	2 years ago
Jiarui Fang	8e14344ec9	[hotfix] fix a type in ColoInitContext (#2106)	2 years ago
Jiarui Fang	05545bfee9	[ColoTensor] throw error when ColoInitContext meets meta parameter. (#2105)	2 years ago
YuliangLiu0306	d87baa85d9	[autoparallel] support linear function bias addition (#2104)	2 years ago
Jiarui Fang	6a71d3a0d9	[version] 0.1.11rc5 -> 0.1.12 (#2103)	2 years ago
YuliangLiu0306	0fecbb9e20	[autoparallel] support addbmm computation (#2102)	2 years ago
YuliangLiu0306	d3d4630495	[autoparallel] add sum handler (#2101)	2 years ago
oahzxl	2b4ebcc278	finishi codegen on msa	2 years ago
Ziyue Jiang	e4705ba4e2	[Pipeline Middleware] fix data race in Pipeline Scheduler for DAG (#2087) ... * add DAG test case * fix datarace by adjusting theposition of lock * polish code * fix pytest for middleware * remove test Co-authored-by: Ziyue Jiang <ziyue.jiang@gmail.com>	2 years ago
YuliangLiu0306	b175e6d58e	[autoparallel] add bias addtion function class (#2098) ... * [autoparallel] add bias addtion function class * polish code * polish	2 years ago
YuliangLiu0306	3af7e65dea	[autoparallel] complete gpt related module search (#2097)	2 years ago
Jiarui Fang	85efb7ac2e	[Gemini] gemini use the runtime memory tracer (RMT) (#2099)	2 years ago
Super Daniel	2bf2d1cd3b	[fx] An experimental version of ColoTracer.' (#2002) ... * [fx] add a symbolic_trace api. * [fx] fix import errors. * [fx] ColoTracer experimental.	2 years ago
Jiarui Fang	4b055351b0	[Gemini] make RuntimeMemTracer work correctly (#2096)	2 years ago
ZijianYY	fa9d1aea71	[example] update GPT README (#2095)	2 years ago
Jiarui Fang	978242326a	[Gemini] remove eval in gemini unittests! (#2092)	2 years ago
YuliangLiu0306	7f72eb0510	[autoparallel]add embedding handler (#2089) ... * [autoparallel] add embedding handler * fix bugs	2 years ago
Jiarui Fang	1fca5d79ea	[Gemini] remove GLOBAL_MODEL_DATA_TRACER (#2091)	2 years ago
Jiarui Fang	28e55c2530	[Gemini] remove GLOBAL_CUDA_MEM_INFO (#2090)	2 years ago
Jiarui Fang	25abae6d7f	[Gemini] use MemStats in Runtime Memory tracer (#2088)	2 years ago
oahzxl	6d99994a7a	rename index tracer	2 years ago
oahzxl	a9d64377bb	support new op	2 years ago
Jiarui Fang	33f4412102	[Gemini] use MemStats to store the tracing data. Seperate it from Collector. (#2084)	2 years ago
oahzxl	f24c418bb0	finish chunk define	2 years ago
Jiarui Fang	1f99205827	[Gemini] remove static tracer (#2083)	2 years ago
oahzxl	3b7d671206	finish region search loop	2 years ago
github-actions[bot]	28ef3f29af	Automated submodule synchronization (#1957) ... Co-authored-by: github-actions <github-actions@github.com>	2 years ago
YuliangLiu0306	0e9db368ef	[autoparallel] add tensor constructor handler (#2082)	2 years ago
YuliangLiu0306	cdf537a648	[autoparallel] add non_split linear strategy (#2078) ... * [autoparallel] add non_split linear stategy * polish	2 years ago
Boyuan Yao	cf0268da93	[autoparallel] Add F.conv metainfo (#2069) ... * [fx] metainfo class for auto parallel * [fx] add unit test for linear metainfo * [fx] fix bwd param for linear * [fx] modify unit test * [fx] modify unit test * [fx] modify import * [fx] modify import * [fx] modify import * [fx] move meta profiler to auto parallel * [fx] add conv metainfo class * [fx] restore profiler * [fx] restore meta profiler * [autoparallel] modify unit test * [fx] modify unit test * [autoparallel] add batchnorm metainfo class * [autoparallel] fix batchnorm unit test function declaration * [fx] restore profiler * [fx] add relu metainfo class * [fx] restore profiler * [autoparallel] modify metainfo input * [autoparallel] add pooling metainfo * [autoparallel] add F.linear metainfo generator * [autoparallel] add binary elementwise metainfo * [fx] recover profiler * [autoparallel] fix forward memory calculation * [autoparallel] modify constants.py * [autoparallel] remove redundant print * [autoparallel] add F.conv metainfo * [autoparallel] linear fix	2 years ago
YuliangLiu0306	f123476666	[autoparallel] complete gpt block searching (#2065) ... * [autoparallel] complete gpt block searching * fix test	2 years ago
Ziyue Jiang	597cdd3006	[Pipeline Middleware] Adapt scheduler for Topo (#2066) ... * adapt scheduler for Topo * remoove comment * fix set input Co-authored-by: Ziyue Jiang <ziyue.jiang@gmail.com>	2 years ago