ColossalAI

Author	SHA1	Message	Date
Zihao	38ea4ba1bd	[Gemini] fix grad unreleased issue and param recovery issue (#2052 )	2022-12-02 16:04:19 +08:00
Zihao	6a9158f1fa	[Gemini] free and allocate cuda memory by tensor.storage, add grad hook (#2040 )	2022-11-30 15:57:45 +08:00
Jiarui Fang	28aa9a4294	[Gemini] more rigorous unit tests for run_fwd_bwd (#2034 )	2022-11-29 09:26:06 +08:00
Zihao	95c4532fff	[Gemini] paramWrapper paramTracerHook unitest (#2030 )	2022-11-26 13:30:24 +08:00
Jiarui Fang	8daf1b4db1	[Gemini] patch for supporting orch.add_ function for ColoTensor (#2003 )	2022-11-25 20:06:35 +08:00
Zihao	a719b89a41	[gemini] param_trace_hook (#2020 )	2022-11-24 18:08:36 +08:00
Jiarui Fang	0b0d8f9e17	[hotfix] revert bug PRs (#2016 )	2022-11-24 15:28:58 +08:00
Zihao	aba3db464d	[Gemini] ParamMemHook (#2008 )	2022-11-24 15:22:51 +08:00