2 Commits (537a3cbc4df445786c8ecf2af0a2998e2fd881b6)

Author	SHA1	Message	Date
Yuanheng Zhao	5be590b99e	[kernel] Support new KCache Layout - Context Attention Triton Kernel (#5658) ... * add context attn triton kernel - new kcache layout * add benchmark triton * tiny revise * trivial - code style, comment	2024-04-26 17:51:49 +08:00
yuehuayingxueluo	0aa27f1961	[Inference]Move benchmark-related code to the example directory. (#5408) ... * move benchmark-related code to the example directory. * fix bugs in test_fused_rotary_embedding.py	2024-02-28 16:46:03 +08:00