2 Commits (6e487e7d3cf5295ca908fa69c8e03af8980391bf)

Author	SHA1	Message	Date
Yuanheng Zhao	0f2b46a41c	[kernel] Revise KVCache copy triton kernel API (#5273) ... * [kernel/fix] revise kvcache copy kernel api * fix benchmark	2024-01-16 14:41:02 +08:00
Yuanheng Zhao	fa85e02b3b	[kernel] Add KV cache copy kernel during decoding (#5261) ... * add kv copy triton kernel during decoding stage * add pytest and fix kernel * fix test utilities * revise kernel config * add benchmark for kvcache copy	2024-01-15 17:37:20 +08:00