4 Commits (8b7495dd541ea12e1af84b3a3a0e24abc1e847d1)

Author	SHA1	Message	Date
Jiarui Fang	867c8c2d3a	[zero] low level optim supports ProcessGroup (#2464)	2023-01-13 10:05:58 +08:00
HELSON	a1ce02d740	[zero] test gradient accumulation (#1964) ... * [zero] fix memory leak for zero2 * [zero] test gradient accumulation * [zero] remove grad clip test	2022-11-29 13:00:30 +08:00
HELSON	7066dfbf82	[zero] fix memory leak for zero2 (#1955)	2022-11-16 11:43:24 +08:00
HELSON	6e51d296f0	[zero] migrate zero1&2 (#1878) ... * add zero1&2 optimizer * rename test ditectory * rename test files * change tolerance in test	2022-11-11 09:26:40 +08:00