Hongxin Liu df63564184 [gemini] support amp o3 for gemini (#4872) ... * [gemini] support no reuse fp16 chunk * [gemini] support no master weight for optim * [gemini] support no master weight for gemini ddp * [test] update gemini tests * [test] update gemini tests * [plugin] update gemini plugin * [test] fix gemini checkpointio test * [test] fix gemini checkpoint io		2023-10-12 10:39:08 +08:00
..
layer	[misc] update pre-commit and run all files (#4752)	2023-09-19 14:20:26 +08:00
loss	[legacy] clean up legacy code (#4743)	2023-09-18 16:31:06 +08:00
lr_scheduler	[misc] add last_epoch in CosineAnnealingWarmupLR (#4778)	2023-09-26 14:43:46 +08:00
optimizer	[gemini] support amp o3 for gemini (#4872)	2023-10-12 10:39:08 +08:00
__init__.py	[legacy] move communication and nn to legacy and refactor logger (#4671)	2023-09-11 16:24:28 +08:00
init.py	[misc] update pre-commit and run all files (#4752)	2023-09-19 14:20:26 +08:00