ColossalAI

Author	SHA1	Message	Date
HELSON	707b11d4a0	[gemini] update ddp strict mode (#2518 ) * [zero] add strict ddp mode for chunk init * [gemini] update gpt example	2023-01-28 14:35:25 +08:00
Jiarui Fang	c89c66a858	[Gemini] update API of the chunkmemstatscollector. (#2129 )	2022-12-14 00:47:06 +08:00
Jiarui Fang	2938edf446	[Gemini] update the non model data record method in runtime memory tracer (#2128 )	2022-12-13 17:11:31 +08:00
Jiarui Fang	deee317b0f	[Gemini] test step-tensor mapping using repeated_computed_layers.py (#2127 )	2022-12-13 16:34:10 +08:00
Jiarui Fang	8fac837679	[Gemini] update non model data calculation method (#2126 )	2022-12-13 15:44:07 +08:00
Jiarui Fang	5efda69735	[Gemini] hotfix the unittest bugs (#2125 )	2022-12-13 14:14:55 +08:00
Jiarui Fang	05bb28aacf	[Gemini] mapping of preop timestep and param (#2124 )	2022-12-13 12:50:24 +08:00
Jiarui Fang	9214d1fe28	[Gemini] chunk init using runtime visited param order (#2115 )	2022-12-12 18:06:16 +08:00
Jiarui Fang	85efb7ac2e	[Gemini] gemini use the runtime memory tracer (RMT) (#2099 )	2022-12-07 23:04:02 +08:00