2 Commits (3de2e622995321b042d4a8cffcd61686cda4a58e)

Author	SHA1	Message	Date
LuGY	839847b7d7	[zero]support zero2 with gradient accumulation (#4511) ... * support gradient accumulation with zero2 * fix type	2023-08-25 13:44:07 +08:00
LuGY	1a49a5ea00	[zero] support shard optimizer state dict of zero (#4194) ... * support shard optimizer of zero * polish code * support sync grad manually	2023-07-31 22:13:29 +08:00