HELSON e7d3afc9cc [optimizer] add div_scale for optimizers (#2117) ... * [optimizer] add div_scale for optimizers * [zero] use div_scale in zero optimizer * fix testing error		2022-12-12 17:58:57 +08:00
..
kernels	…
colossal_C_frontend.cpp	[optimizer] add div_scale for optimizers (#2117)	2022-12-12 17:58:57 +08:00
compat.h	…
cpu_adam.cpp	[hotfix] fix CPUAdam kernel nullptr (#1410)	2022-08-05 19:45:45 +08:00
cpu_adam.h	[hotfix] fix CPUAdam kernel nullptr (#1410)	2022-08-05 19:45:45 +08:00
layer_norm_cuda.cpp	…
layer_norm_cuda_kernel.cu	…
moe_cuda.cpp	…
moe_cuda_kernel.cu	…
multi_tensor_adam.cu	[optimizer] add div_scale for optimizers (#2117)	2022-12-12 17:58:57 +08:00
multi_tensor_apply.cuh	…
multi_tensor_l2norm_kernel.cu	…
multi_tensor_lamb.cu	…
multi_tensor_scale_kernel.cu	…
multi_tensor_sgd_kernel.cu	…
multihead_attention_1d.cpp	[hotfix] fix build error when torch version >= 1.13 (#1803)	2022-11-08 09:40:24 +08:00
multihead_attention_1d.h	[hotfix] fix build error when torch version >= 1.13 (#1803)	2022-11-08 09:40:24 +08:00
scaled_masked_softmax.cpp	…
scaled_masked_softmax.h	…
scaled_masked_softmax_cuda.cu	…
scaled_upper_triang_masked_softmax.cpp	…
scaled_upper_triang_masked_softmax.h	…
scaled_upper_triang_masked_softmax_cuda.cu	…
type_shim.h	…