22 Commits (deee317b0ff54eeec2e03b10dc2a0e7b7b0d9ea3)

Author	SHA1	Message	Date
Jiarui Fang	8fac837679	[Gemini] update non model data calculation method (#2126)	2022-12-13 15:44:07 +08:00
Jiarui Fang	05bb28aacf	[Gemini] mapping of preop timestep and param (#2124)	2022-12-13 12:50:24 +08:00
Jiarui Fang	70a8556946	[gemini] get the param visited order during runtime (#2108)	2022-12-09 16:13:03 +08:00
Jiarui Fang	4b055351b0	[Gemini] make RuntimeMemTracer work correctly (#2096)	2022-12-07 16:59:59 +08:00
Jiarui Fang	28e55c2530	[Gemini] remove GLOBAL_CUDA_MEM_INFO (#2090)	2022-12-06 22:10:47 +08:00
Jiarui Fang	25abae6d7f	[Gemini] use MemStats in Runtime Memory tracer (#2088)	2022-12-06 19:48:20 +08:00
Jiarui Fang	b3b89865e2	[Gemini] ParamOpHook -> ColoParamOpHook (#2080)	2022-12-05 17:11:06 +08:00
Jiarui Fang	a7adad9ccb	[Gemini] rename hooks related to runtime mem tracer (#2076)	2022-12-05 15:00:03 +08:00
Zihao	38ea4ba1bd	[Gemini] fix grad unreleased issue and param recovery issue (#2052)	2022-12-02 16:04:19 +08:00
Zihao	6a9158f1fa	[Gemini] free and allocate cuda memory by tensor.storage, add grad hook (#2040)	2022-11-30 15:57:45 +08:00
Jiarui Fang	28aa9a4294	[Gemini] more rigorous unit tests for run_fwd_bwd (#2034)	2022-11-29 09:26:06 +08:00
Zihao	95c4532fff	[Gemini] paramWrapper paramTracerHook unitest (#2030)	2022-11-26 13:30:24 +08:00
Jiarui Fang	8daf1b4db1	[Gemini] patch for supporting orch.add_ function for ColoTensor (#2003)	2022-11-25 20:06:35 +08:00
Zihao	a719b89a41	[gemini] param_trace_hook (#2020)	2022-11-24 18:08:36 +08:00
Jiarui Fang	0b0d8f9e17	[hotfix] revert bug PRs (#2016)	2022-11-24 15:28:58 +08:00
Zihao	aba3db464d	[Gemini] ParamMemHook (#2008)	2022-11-24 15:22:51 +08:00
Jiarui Fang	3712ac7f90	[Gemini] add bert for MemtracerWrapper unintests (#1982)	2022-11-18 14:58:28 +08:00
Jiarui Fang	e481489aa6	[Gemini] MemtracerWrapper unittests (#1981)	2022-11-18 14:19:40 +08:00
Jiarui Fang	31922110ad	[Gemini] memory trace hook (#1978)	2022-11-18 11:52:55 +08:00
Jiarui Fang	0529fcde06	[Gemini] independent runtime tracer (#1974)	2022-11-18 10:53:42 +08:00
Jiarui Fang	7e24b9b9ee	[Gemini] clean no used MemTraceOp (#1970)	2022-11-17 13:41:54 +08:00
Jiarui Fang	4165eabb1e	[hotfix] remove potiential circle import (#1307) ... * make it faster * [hotfix] remove circle import	2022-07-14 13:44:26 +08:00