Commit Graph

1 Commits (c647e00e3c092d3d6219f7686f260f2932a0c27d)

Author SHA1 Message Date
Jianghai c647e00e3c
[Inference]Add fused rotary kernel and get cos cache kernel (#5302)
* add fused rotary and get cos cache func

* staged

* fix bugs

* fix bugs
2024-01-24 16:20:42 +08:00