You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

xcnick 85178a397a [hotfix] fix error for torch 2.0 (#2243)		2 years ago
..
kernels	Recover kernal files	2 years ago
colossal_C_frontend.cpp	[optimizer] add div_scale for optimizers (#2117)	2 years ago
compat.h	…
cpu_adam.cpp	[hotfix] fix CPUAdam kernel nullptr (#1410)	2 years ago
cpu_adam.h	[hotfix] fix CPUAdam kernel nullptr (#1410)	2 years ago
layer_norm_cuda.cpp	…
layer_norm_cuda_kernel.cu	…
moe_cuda.cpp	…
moe_cuda_kernel.cu	…
multi_tensor_adam.cu	[optimizer] add div_scale for optimizers (#2117)	2 years ago
multi_tensor_apply.cuh	Recover kernal files	2 years ago
multi_tensor_l2norm_kernel.cu	…
multi_tensor_lamb.cu	…
multi_tensor_scale_kernel.cu	…
multi_tensor_sgd_kernel.cu	…
multihead_attention_1d.cpp	[hotfix] fix error for torch 2.0 (#2243)	2 years ago
multihead_attention_1d.h	[hotfix] fix error for torch 2.0 (#2243)	2 years ago
scaled_masked_softmax.cpp	Recover kernal files	2 years ago
scaled_masked_softmax.h	Recover kernal files	2 years ago
scaled_masked_softmax_cuda.cu	…
scaled_upper_triang_masked_softmax.cpp	…
scaled_upper_triang_masked_softmax.h	Recover kernal files	2 years ago
scaled_upper_triang_masked_softmax_cuda.cu	…
type_shim.h	Recover kernal files	2 years ago