ColossalAI

Author	SHA1	Message	Date
Zihao	38ea4ba1bd	[Gemini] fix grad unreleased issue and param recovery issue (#2052 )	2022-12-02 16:04:19 +08:00
Zihao	6a9158f1fa	[Gemini] free and allocate cuda memory by tensor.storage, add grad hook (#2040 )	2022-11-30 15:57:45 +08:00
Jiarui Fang	28aa9a4294	[Gemini] more rigorous unit tests for run_fwd_bwd (#2034 )	2022-11-29 09:26:06 +08:00
Zihao	95c4532fff	[Gemini] paramWrapper paramTracerHook unitest (#2030 )	2022-11-26 13:30:24 +08:00
Jiarui Fang	8daf1b4db1	[Gemini] patch for supporting orch.add_ function for ColoTensor (#2003 )	2022-11-25 20:06:35 +08:00
Zihao	a719b89a41	[gemini] param_trace_hook (#2020 )	2022-11-24 18:08:36 +08:00
Jiarui Fang	0b0d8f9e17	[hotfix] revert bug PRs (#2016 )	2022-11-24 15:28:58 +08:00
Zihao	aba3db464d	[Gemini] ParamMemHook (#2008 )	2022-11-24 15:22:51 +08:00
Jiarui Fang	3712ac7f90	[Gemini] add bert for MemtracerWrapper unintests (#1982 )	2022-11-18 14:58:28 +08:00
Jiarui Fang	e481489aa6	[Gemini] MemtracerWrapper unittests (#1981 )	2022-11-18 14:19:40 +08:00
Jiarui Fang	31922110ad	[Gemini] memory trace hook (#1978 )	2022-11-18 11:52:55 +08:00
Jiarui Fang	0529fcde06	[Gemini] independent runtime tracer (#1974 )	2022-11-18 10:53:42 +08:00
Jiarui Fang	7e24b9b9ee	[Gemini] clean no used MemTraceOp (#1970 )	2022-11-17 13:41:54 +08:00
Jiarui Fang	4165eabb1e	[hotfix] remove potiential circle import (#1307 ) * make it faster * [hotfix] remove circle import	2022-07-14 13:44:26 +08:00