ColossalAI/tests/test_infer_ops
Jianghai c647e00e3c
[Inference]Add fused rotary kernel and get cos cache kernel (#5302)
* add fused rotary and get cos cache func

* staged

* fix bugs

* fix bugs
2024-01-24 16:20:42 +08:00
..
triton [Inference]Add fused rotary kernel and get cos cache kernel (#5302) 2024-01-24 16:20:42 +08:00