Yuanheng Zhao e60d430cf5 [Fix] resolve conflicts of rebasing feat/speculative-decoding (#5557) ... - resolve conflicts of rebasing feat/speculative-decoding		2024-04-10 18:13:49 +08:00
..
__init__.py	[Inference]Add CUDA KVCache Kernel (#5406)	2024-02-28 14:36:50 +08:00
kernel_utils.py	[Inference/SpecDec] Add Speculative Decoding Implementation (#5423)	2024-04-10 11:07:52 +08:00
test_context_attn_unpad.py	[Inference]Move benchmark-related code to the example directory. (#5408)	2024-02-28 16:46:03 +08:00
test_decoding_attn.py	[Fix] resolve conflicts of rebasing feat/speculative-decoding (#5557)	2024-04-10 18:13:49 +08:00
test_fused_rotary_embedding.py	[Inference]Move benchmark-related code to the example directory. (#5408)	2024-02-28 16:46:03 +08:00
test_kvcache_copy.py	[Fix] resolve conflicts of rebasing feat/speculative-decoding (#5557)	2024-04-10 18:13:49 +08:00
test_rmsnorm_triton.py	[Inference]Move benchmark-related code to the example directory. (#5408)	2024-02-28 16:46:03 +08:00
test_rotary_embdding_unpad.py	[Inference]Move benchmark-related code to the example directory. (#5408)	2024-02-28 16:46:03 +08:00
test_xine_copy.py	[Inference]Move benchmark-related code to the example directory. (#5408)	2024-02-28 16:46:03 +08:00