Jiarui Fang e761ad2cd7 Revert "[zero] add ZeroTensorShardStrategy (#793)" (#806)		2022-04-19 14:40:02 +08:00
..
kernels	[NFC] polish colossalai/kernel/cuda_native/csrc/kernels/include/cuda_util.h code style (#641)	2022-04-06 11:40:59 +08:00
colossal_C_frontend.cpp	…
compat.h	…
cpu_adam.cpp	[NFC] polish colossalai/kernel/cuda_native/csrc/cpu_adam.cpp code style (#636)	2022-04-06 11:40:59 +08:00
cpu_adam.h	…
layer_norm_cuda.cpp	…
layer_norm_cuda_kernel.cu	[NFC] polish colossalai/kernel/cuda_native/csrc/layer_norm_cuda_kernel.cu code style (#661)	2022-04-06 11:40:59 +08:00
moe_cuda.cpp	[NFC] polish colossalai/kernel/cuda_native/csrc/moe_cuda.cpp code style (#642)	2022-04-06 11:40:59 +08:00
moe_cuda_kernel.cu	…
multi_tensor_adam.cu	[NFC] polish colossalai/kernel/cuda_native/csrc/multi_tensor_adam.cu code style (#667)	2022-04-06 11:40:59 +08:00
multi_tensor_apply.cuh	…
multi_tensor_l2norm_kernel.cu	[NFC] polish colossalai/kernel/cuda_native/csrc/multi_tensor_l2norm_kernel.cu code style (#635)	2022-04-06 11:40:59 +08:00
multi_tensor_lamb.cu	…
multi_tensor_scale_kernel.cu	…
multi_tensor_sgd_kernel.cu	…
multihead_attention_1d.cpp	…
multihead_attention_1d.h	…
scaled_masked_softmax.cpp	…
scaled_masked_softmax.h	…
scaled_masked_softmax_cuda.cu	…
scaled_upper_triang_masked_softmax.cpp	…
scaled_upper_triang_masked_softmax.h	…
scaled_upper_triang_masked_softmax_cuda.cu	…
type_shim.h	…