ColossalAI

Author	SHA1	Message	Date
HELSON	707b11d4a0	[gemini] update ddp strict mode (#2518 ) * [zero] add strict ddp mode for chunk init * [gemini] update gpt example	2023-01-28 14:35:25 +08:00
HELSON	7829aa094e	[ddp] add is_ddp_ignored (#2434 ) [ddp] rename to is_ddp_ignored	2023-01-11 12:22:45 +08:00
Jiarui Fang	9214d1fe28	[Gemini] chunk init using runtime visited param order (#2115 )	2022-12-12 18:06:16 +08:00
Jiarui Fang	e5aa8333e4	[NFC] update chunk manager API (#2119 )	2022-12-12 16:57:22 +08:00
Jiarui Fang	8afc001f4f	[Gemini] chunk init use OrderedParamGenerator (#2110 )	2022-12-11 21:41:13 +08:00
Jiarui Fang	61f31c3cf0	[Gemini] NFC, polish search_chunk_configuration (#2107 )	2022-12-09 15:00:39 +08:00
HELSON	f69f9bf223	[zero] add chunk init function for users (#1729 ) * add chunk manager init function * fix unit tests * add comment * add flush=True	2022-10-18 16:31:22 +08:00
HELSON	b28991dd0a	[feature] A new ZeRO implementation (#1644 )	2022-10-09 09:18:51 +08:00
Jiarui Fang	c5d39215f6	Revert "[feature] new zero implementation (#1623 )" (#1643 ) This reverts commit `5be118f405`.	2022-09-26 10:06:03 +08:00
HELSON	5be118f405	[feature] new zero implementation (#1623 )	2022-09-24 19:58:18 +08:00