2 Commits (56ed09aba5e017fc0c211dac70215c2f83815919)

Author	SHA1	Message	Date
Yuanheng Zhao	5be590b99e	[kernel] Support new KCache Layout - Context Attention Triton Kernel (#5658) ... * add context attn triton kernel - new kcache layout * add benchmark triton * tiny revise * trivial - code style, comment	2024-04-26 17:51:49 +08:00
yuehuayingxueluo	0aa27f1961	[Inference]Move benchmark-related code to the example directory. (#5408) ... * move benchmark-related code to the example directory. * fix bugs in test_fused_rotary_embedding.py	2024-02-28 16:46:03 +08:00