ColossalAI/colossalai/amp/naive_amp
HELSON 077a5cdde4
[zero] fix gradient clipping in hybrid parallelism (#2521)
* [zero] fix gradient clipping in hybrid parallelism

* [testing] change model name to avoid pytest warning

* [hotfix] fix unit testing
2023-01-29 15:09:57 +08:00
..
grad_scaler [zero] fix gradient clipping in hybrid parallelism (#2521) 2023-01-29 15:09:57 +08:00
__init__.py [NFC] polish colossalai/amp/naive_amp/__init__.py code style (#1905) 2022-11-11 17:49:18 +08:00
_fp16_optimizer.py [setup] support pre-build and jit-build of cuda kernels (#2374) 2023-01-06 20:50:26 +08:00
_utils.py [NFC] polish colossalai/amp/naive_amp/_utils.py code style (#1816) 2022-11-09 12:08:47 +08:00
naive_amp.py [amp] add gradient clipping for unit tests (#2283) 2023-01-04 11:59:56 +08:00