Commit Graph

1 Commits (deee317b0ff54eeec2e03b10dc2a0e7b7b0d9ea3)

Author SHA1 Message Date
HELSON 63fbba3c19
[zero] add L2 gradient clipping for ZeRO (#2112)
* [zero] add L2 gradient clipping

* [testing] add MlpModel

* [zero] add unit test for grad clipping

* fix atol
2022-12-09 18:09:17 +08:00