HELSON 63fbba3c19 [zero] add L2 gradient clipping for ZeRO (#2112) ... * [zero] add L2 gradient clipping * [testing] add MlpModel * [zero] add unit test for grad clipping * fix atol		2022-12-09 18:09:17 +08:00
..
__init__.py	[Gemini] NFC, polish search_chunk_configuration (#2107)	2022-12-09 15:00:39 +08:00
chunk.py	[zero] add L2 gradient clipping for ZeRO (#2112)	2022-12-09 18:09:17 +08:00
manager.py	[hotfix] fix zero's incompatibility with checkpoint in torch-1.12 (#1786)	2022-11-02 16:11:34 +08:00
search_utils.py	[Gemini] NFC, polish search_chunk_configuration (#2107)	2022-12-09 15:00:39 +08:00
utils.py	[zero] add chunk init function for users (#1729)	2022-10-18 16:31:22 +08:00