You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
ColossalAI/colossalai/kernel/cuda_native/csrc
LuGY a3269de5c9
[zero] cpu adam kernel (#288)
3 years ago
..
kernels add colossalai kernel module (#55) 3 years ago
colossal_C_frontend.cpp refactor kernel (#142) 3 years ago
compat.h refactor kernel (#142) 3 years ago
cpu_adam.cpp [zero] cpu adam kernel (#288) 3 years ago
cpu_adam.h [zero] cpu adam kernel (#288) 3 years ago
layer_norm_cuda.cpp add colossalai kernel module (#55) 3 years ago
layer_norm_cuda_kernel.cu Optimized MoE layer and fixed some bugs; 3 years ago
moe_cuda.cpp Optimized MoE layer and fixed some bugs; 3 years ago
moe_cuda_kernel.cu Optimized MoE layer and fixed some bugs; 3 years ago
multi_tensor_adam.cu refactor kernel (#142) 3 years ago
multi_tensor_apply.cuh refactor kernel (#142) 3 years ago
multi_tensor_l2norm_kernel.cu refactor kernel (#142) 3 years ago
multi_tensor_lamb.cu refactor kernel (#142) 3 years ago
multi_tensor_scale_kernel.cu refactor kernel (#142) 3 years ago
multi_tensor_sgd_kernel.cu refactor kernel (#142) 3 years ago
multihead_attention_1d.cpp add colossalai kernel module (#55) 3 years ago
multihead_attention_1d.h add colossalai kernel module (#55) 3 years ago
scaled_masked_softmax.cpp add colossalai kernel module (#55) 3 years ago
scaled_masked_softmax.h add colossalai kernel module (#55) 3 years ago
scaled_masked_softmax_cuda.cu add colossalai kernel module (#55) 3 years ago
scaled_upper_triang_masked_softmax.cpp add colossalai kernel module (#55) 3 years ago
scaled_upper_triang_masked_softmax.h add colossalai kernel module (#55) 3 years ago
scaled_upper_triang_masked_softmax_cuda.cu add colossalai kernel module (#55) 3 years ago
type_shim.h refactor kernel (#142) 3 years ago