mirror of https://github.com/hpcaitech/ColossalAI
a3269de5c9
* Added CPU Adam * finished the cpu adam * updated the license * delete useless parameters, removed resnet * modified the method off cpu adam unittest * deleted some useless codes * removed useless codes Co-authored-by: ver217 <lhx0217@gmail.com> Co-authored-by: Frank Lee <somerlee.9@gmail.com> Co-authored-by: jiaruifang <fangjiarui123@gmail.com> |
||
|---|---|---|
| .. | ||
| kernels | ||
| colossal_C_frontend.cpp | ||
| compat.h | ||
| cpu_adam.cpp | ||
| cpu_adam.h | ||
| layer_norm_cuda.cpp | ||
| layer_norm_cuda_kernel.cu | ||
| moe_cuda.cpp | ||
| moe_cuda_kernel.cu | ||
| multi_tensor_adam.cu | ||
| multi_tensor_apply.cuh | ||
| multi_tensor_l2norm_kernel.cu | ||
| multi_tensor_lamb.cu | ||
| multi_tensor_scale_kernel.cu | ||
| multi_tensor_sgd_kernel.cu | ||
| multihead_attention_1d.cpp | ||
| multihead_attention_1d.h | ||
| scaled_masked_softmax.cpp | ||
| scaled_masked_softmax.h | ||
| scaled_masked_softmax_cuda.cu | ||
| scaled_upper_triang_masked_softmax.cpp | ||
| scaled_upper_triang_masked_softmax.h | ||
| scaled_upper_triang_masked_softmax_cuda.cu | ||
| type_shim.h | ||