2 Commits (34e909256c3fb43e5cec2c4c53437166557eb39a)

Author	SHA1	Message	Date
LuGY	839847b7d7	[zero]support zero2 with gradient accumulation (#4511) ... * support gradient accumulation with zero2 * fix type	2023-08-25 13:44:07 +08:00
LuGY	1a49a5ea00	[zero] support shard optimizer state dict of zero (#4194) ... * support shard optimizer of zero * polish code * support sync grad manually	2023-07-31 22:13:29 +08:00