Commit Graph

1 Commits (db1a763307a54ca262751ebebd5f1c503d9bca74)

Author SHA1 Message Date
Jianghai c647e00e3c
[Inference]Add fused rotary kernel and get cos cache kernel (#5302)
* add fused rotary and get cos cache func

* staged

* fix bugs

* fix bugs
2024-01-24 16:20:42 +08:00