ColossalAI

Author	SHA1	Message	Date
HELSON	2d1a7dfe5f	[zero] add strict ddp mode (#2508 ) * [zero] add strict ddp mode * [polish] add comments for strict ddp mode * [zero] fix test error	2023-01-20 14:04:38 +08:00
Jiarui Fang	9214d1fe28	[Gemini] chunk init using runtime visited param order (#2115 )	2022-12-12 18:06:16 +08:00
Jiarui Fang	1f99205827	[Gemini] remove static tracer (#2083 )	2022-12-06 12:53:58 +08:00
HELSON	e37f3db40c	[gemini] add arguments (#2046 ) * [zero] fix testing parameters * [gemini] add arguments * add docstrings	2022-11-30 16:40:13 +08:00
Jiarui Fang	f7e276fa71	[Gemini] add GeminiAdamOptimizer (#1960 )	2022-11-16 14:44:28 +08:00
Jiarui Fang	cd5a0d56fa	[Gemini] make gemini usage simple (#1821 )	2022-11-08 15:53:13 +08:00