ColossalAI/colossalai/kernel/__init__.py

mirror of https://github.com/hpcaitech/ColossalAI
from .cuda_native import LayerNorm, FusedScaleMaskSoftmax, MultiHeadAttention

__all__ = ["LayerNorm", "FusedScaleMaskSoftmax", "MultiHeadAttention"]
add colossalai kernel module (#55) 2021-12-21 04:19:52 +00:00			`from .cuda_native import LayerNorm, FusedScaleMaskSoftmax, MultiHeadAttention`

fix format (#568) 2022-03-31 07:13:01 +00:00			`__all__ = ["LayerNorm", "FusedScaleMaskSoftmax", "MultiHeadAttention"]`