ColossalAI/colossalai/kernel/cuda_native
LuGY 6a3f9fda83
[cuda] modify the fused adam, support hybrid of fp16 and fp32 (#497)
2022-03-25 14:15:53 +08:00
..
csrc [cuda] modify the fused adam, support hybrid of fp16 and fp32 (#497) 2022-03-25 14:15:53 +08:00
__init__.py refactor kernel (#142) 2022-01-13 16:47:17 +08:00
layer_norm.py [formart] format fixed for kernel\cuda_native codes (#335) 2022-03-11 15:50:28 +08:00
multihead_attention.py [formart] format fixed for kernel\cuda_native codes (#335) 2022-03-11 15:50:28 +08:00
scaled_softmax.py Fixed docstring in colossalai (#171) 2022-01-21 10:44:30 +08:00