ColossalAI/colossalai/amp/naive_amp/grad_scaler
HELSON 077a5cdde4
[zero] fix gradient clipping in hybrid parallelism (#2521)
* [zero] fix gradient clipping in hybrid parallelism

* [testing] change model name to avoid pytest warning

* [hotfix] fix unit testing
2023-01-29 15:09:57 +08:00
..
__init__.py
base_grad_scaler.py [NFC] polish amp.naive_amp.grad_scaler code style 2022-11-09 13:38:15 +08:00
constant_grad_scaler.py
dynamic_grad_scaler.py [zero] fix gradient clipping in hybrid parallelism (#2521) 2023-01-29 15:09:57 +08:00