HELSON 077a5cdde4 [zero] fix gradient clipping in hybrid parallelism (#2521) ... * [zero] fix gradient clipping in hybrid parallelism * [testing] change model name to avoid pytest warning * [hotfix] fix unit testing		2023-01-29 15:09:57 +08:00
..
apex_amp	[NFC] polish colossalai/amp/apex_amp/__init__.py code style (#1853)	2022-11-09 14:49:42 +08:00
naive_amp	[zero] fix gradient clipping in hybrid parallelism (#2521)	2023-01-29 15:09:57 +08:00
torch_amp	[NFC] polish colossalai/amp/torch_amp/torch_amp.py code style (#2290)	2023-01-04 15:09:57 +08:00
__init__.py	[refactor] zero directory (#724)	2022-04-11 23:13:02 +08:00
amp_type.py	Develop/experiments (#59)	2021-12-09 15:08:29 +08:00