傅剑寒 7ff42cc06d add vec_type_trait implementation (#5473)		2024-03-19 18:36:40 +08:00
..
include	refactor code	2024-03-08 15:41:14 +08:00
pybind	[Inference/kernel]Add Fused Rotary Embedding and KVCache Memcopy CUDA Kernel (#5418)	2024-03-13 17:20:03 +08:00
utils	add vec_type_trait implementation (#5473)	2024-03-19 18:36:40 +08:00
activation_kernel.cu	add vec_type_trait implementation (#5473)	2024-03-19 18:36:40 +08:00
decode_kv_cache_memcpy_kernel.cu	refactor vector utils	2024-03-19 11:32:01 +08:00
fused_rotary_emb_and_cache_kernel.cu	refactor vector utils	2024-03-19 11:32:01 +08:00
layer_norm_kernel.cu	refactor code	2024-03-11 17:06:57 +08:00
moe_kernel.cu	refactor code	2024-03-11 17:06:57 +08:00
multi_tensor_adam_kernel.cu	refactor code	2024-03-11 17:06:57 +08:00
multi_tensor_apply.cuh	refactor code	2024-03-08 15:41:14 +08:00
multi_tensor_l2norm_kernel.cu	refactor code	2024-03-08 15:41:14 +08:00
multi_tensor_lamb_kernel.cu	refactor code	2024-03-11 17:06:57 +08:00
multi_tensor_scale_kernel.cu	refactor code	2024-03-08 15:41:14 +08:00
multi_tensor_sgd_kernel.cu	refactor code	2024-03-08 15:41:14 +08:00
rms_layernorm_kernel.cu	refactor vector utils	2024-03-19 11:32:01 +08:00
scaled_masked_softmax.h	refactor vector utils	2024-03-19 11:32:01 +08:00
scaled_masked_softmax_kernel.cu	refactor code	2024-03-11 17:06:57 +08:00
scaled_upper_triang_masked_softmax.h	refactor vector utils	2024-03-19 11:32:01 +08:00
scaled_upper_triang_masked_softmax_kernel.cu	refactor code	2024-03-11 17:06:57 +08:00