ColossalAI/colossalai/kernel/cuda_native/csrc
ver217 f68eddfb3d
refactor kernel (#142)
2022-01-13 16:47:17 +08:00
..
kernels add colossalai kernel module (#55) 2021-12-21 12:19:52 +08:00
colossal_C_frontend.cpp refactor kernel (#142) 2022-01-13 16:47:17 +08:00
compat.h refactor kernel (#142) 2022-01-13 16:47:17 +08:00
layer_norm_cuda.cpp add colossalai kernel module (#55) 2021-12-21 12:19:52 +08:00
layer_norm_cuda_kernel.cu add colossalai kernel module (#55) 2021-12-21 12:19:52 +08:00
multi_tensor_adam.cu refactor kernel (#142) 2022-01-13 16:47:17 +08:00
multi_tensor_apply.cuh refactor kernel (#142) 2022-01-13 16:47:17 +08:00
multi_tensor_l2norm_kernel.cu refactor kernel (#142) 2022-01-13 16:47:17 +08:00
multi_tensor_lamb.cu refactor kernel (#142) 2022-01-13 16:47:17 +08:00
multi_tensor_scale_kernel.cu refactor kernel (#142) 2022-01-13 16:47:17 +08:00
multi_tensor_sgd_kernel.cu refactor kernel (#142) 2022-01-13 16:47:17 +08:00
multihead_attention_1d.cpp add colossalai kernel module (#55) 2021-12-21 12:19:52 +08:00
multihead_attention_1d.h add colossalai kernel module (#55) 2021-12-21 12:19:52 +08:00
scaled_masked_softmax.cpp add colossalai kernel module (#55) 2021-12-21 12:19:52 +08:00
scaled_masked_softmax.h add colossalai kernel module (#55) 2021-12-21 12:19:52 +08:00
scaled_masked_softmax_cuda.cu add colossalai kernel module (#55) 2021-12-21 12:19:52 +08:00
scaled_upper_triang_masked_softmax.cpp add colossalai kernel module (#55) 2021-12-21 12:19:52 +08:00
scaled_upper_triang_masked_softmax.h add colossalai kernel module (#55) 2021-12-21 12:19:52 +08:00
scaled_upper_triang_masked_softmax_cuda.cu add colossalai kernel module (#55) 2021-12-21 12:19:52 +08:00
type_shim.h refactor kernel (#142) 2022-01-13 16:47:17 +08:00