ColossalAI/extensions/csrc/cuda/pybind
yuehuayingxueluo 04aca9e55b
[Inference/Kernel]Add get_cos_and_sin Kernel (#5528)
* Add get_cos_and_sin kernel

* fix code comments

* fix code typos

* merge common codes of get_cos_and_sin kernel.

* Fixed a typo

* Changed 'asset allclose' to 'assert equal'.
2024-04-01 13:47:14 +08:00
..
inference.cpp [Inference/Kernel]Add get_cos_and_sin Kernel (#5528) 2024-04-01 13:47:14 +08:00
layer_norm.cpp fix include path 2024-03-13 11:21:06 +08:00
moe.cpp refactor code 2024-03-11 17:06:57 +08:00
optimizer.cpp refactor code 2024-03-11 17:06:57 +08:00
scaled_masked_softmax.cpp refactor code 2024-03-11 17:06:57 +08:00
scaled_upper_triang_masked_softmax.cpp refactor code 2024-03-11 17:06:57 +08:00