You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
ColossalAI/colossalai/kernel/cuda_native
LuGY 6a3f9fda83
[cuda] modify the fused adam, support hybrid of fp16 and fp32 (#497)
3 years ago
..
csrc [cuda] modify the fused adam, support hybrid of fp16 and fp32 (#497) 3 years ago
__init__.py refactor kernel (#142) 3 years ago
layer_norm.py [formart] format fixed for kernel\cuda_native codes (#335) 3 years ago
multihead_attention.py [formart] format fixed for kernel\cuda_native codes (#335) 3 years ago
scaled_softmax.py Fixed docstring in colossalai (#171) 3 years ago