2 Commits (0f2b46a41c2c308cc6fbeaf0e86d0e0b93435b77)

Author	SHA1	Message	Date
Yuanheng Zhao	0f2b46a41c	[kernel] Revise KVCache copy triton kernel API (#5273) ... * [kernel/fix] revise kvcache copy kernel api * fix benchmark	2024-01-16 14:41:02 +08:00
Yuanheng Zhao	fa85e02b3b	[kernel] Add KV cache copy kernel during decoding (#5261) ... * add kv copy triton kernel during decoding stage * add pytest and fix kernel * fix test utilities * revise kernel config * add benchmark for kvcache copy	2024-01-15 17:37:20 +08:00