4 Commits (5cd8cae0c9db7ae4bfb98e42ec9c7ab2e6ebd17f)

Author	SHA1	Message	Date
HELSON	e7d3afc9cc	[optimizer] add div_scale for optimizers (#2117) ... * [optimizer] add div_scale for optimizers * [zero] use div_scale in zero optimizer * fix testing error	2022-12-12 17:58:57 +08:00
encmps	79ccfa4310	[NFC] polish colossalai/kernel/cuda_native/csrc/multi_tensor_adam.cu code style (#667)	2022-04-06 11:40:59 +08:00
LuGY	6a3f9fda83	[cuda] modify the fused adam, support hybrid of fp16 and fp32 (#497)	2022-03-25 14:15:53 +08:00
ver217	f68eddfb3d	refactor kernel (#142)	2022-01-13 16:47:17 +08:00