HELSON 077a5cdde4 [zero] fix gradient clipping in hybrid parallelism (#2521) ... * [zero] fix gradient clipping in hybrid parallelism * [testing] change model name to avoid pytest warning * [hotfix] fix unit testing		2023-01-29 15:09:57 +08:00
..
grad_scaler	[zero] fix gradient clipping in hybrid parallelism (#2521)	2023-01-29 15:09:57 +08:00
__init__.py	…
_fp16_optimizer.py	[setup] support pre-build and jit-build of cuda kernels (#2374)	2023-01-06 20:50:26 +08:00
_utils.py	…
naive_amp.py	[amp] add gradient clipping for unit tests (#2283)	2023-01-04 11:59:56 +08:00