3 Commits (6c39f0b144d66db1044be081657cdf899ab31053)

Author	SHA1	Message	Date
Yuanheng Zhao	8754abae24	[Fix] Fix & Update Inference Tests (compatibility w/ main)	2024-05-05 16:28:56 +00:00
Yuanheng Zhao	5be590b99e	[kernel] Support new KCache Layout - Context Attention Triton Kernel (#5658) ... * add context attn triton kernel - new kcache layout * add benchmark triton * tiny revise * trivial - code style, comment	2024-04-26 17:51:49 +08:00
yuehuayingxueluo	0aa27f1961	[Inference]Move benchmark-related code to the example directory. (#5408) ... * move benchmark-related code to the example directory. * fix bugs in test_fused_rotary_embedding.py	2024-02-28 16:46:03 +08:00