2 Commits (0b14a5512e5220450b61effd15ff2d9c93ef7d22)

Author	SHA1	Message	Date
LuGY	839847b7d7	[zero]support zero2 with gradient accumulation (#4511) ... * support gradient accumulation with zero2 * fix type	2023-08-25 13:44:07 +08:00
LuGY	1a49a5ea00	[zero] support shard optimizer state dict of zero (#4194) ... * support shard optimizer of zero * polish code * support sync grad manually	2023-07-31 22:13:29 +08:00