HELSON 63fbba3c19 [zero] add L2 gradient clipping for ZeRO (#2112) ... * [zero] add L2 gradient clipping * [testing] add MlpModel * [zero] add unit test for grad clipping * fix atol		2022-12-09 18:09:17 +08:00
..
_ops	[hotfix] add bert test for gemini fwd bwd (#2035)	2022-11-29 11:19:52 +08:00
graph	[NFC] polish doc style for ColoTensor (#1457)	2022-08-16 09:21:05 +08:00
layer	[kernel] move all symlinks of kernel to `colossalai._C` (#1971)	2022-11-17 13:42:33 +08:00
loss	[NFC] polish colossalai/nn/loss/loss_2p5d.py code style (#1553)	2022-09-08 22:11:04 +08:00
lr_scheduler	[NFC] polish colossalai/nn/lr_scheduler/linear.py code style (#1716)	2022-10-19 12:20:51 +08:00
metric	[NFC] polish colossalai/nn/metric/_utils.py code style (#1727)	2022-10-19 12:20:51 +08:00
optimizer	[zero] add L2 gradient clipping for ZeRO (#2112)	2022-12-09 18:09:17 +08:00
parallel	[zero] add L2 gradient clipping for ZeRO (#2112)	2022-12-09 18:09:17 +08:00
__init__.py	[kernel] added jit warmup (#1792)	2022-11-08 16:22:23 +08:00
init.py	[NFC] polish colossalai/nn/init.py code style (#1292)	2022-07-13 10:51:55 +08:00