yuehuayingxueluo 0aa27f1961 [Inference]Move benchmark-related code to the example directory. (#5408) ... * move benchmark-related code to the example directory. * fix bugs in test_fused_rotary_embedding.py		2024-02-28 16:46:03 +08:00
..
__init__.py	[Inference]Add CUDA KVCache Kernel (#5406)	2024-02-28 14:36:50 +08:00
kernel_utils.py	[inference] moved ops tests to test_infer (#5354)	2024-02-02 13:51:22 +08:00
test_context_attn_unpad.py	[Inference]Move benchmark-related code to the example directory. (#5408)	2024-02-28 16:46:03 +08:00
test_decoding_attn.py	[Inference]Move benchmark-related code to the example directory. (#5408)	2024-02-28 16:46:03 +08:00
test_fused_rotary_embedding.py	[Inference]Move benchmark-related code to the example directory. (#5408)	2024-02-28 16:46:03 +08:00
test_kvcache_copy.py	[Inference]Add CUDA KVCache Kernel (#5406)	2024-02-28 14:36:50 +08:00
test_rmsnorm_triton.py	[Inference]Move benchmark-related code to the example directory. (#5408)	2024-02-28 16:46:03 +08:00
test_rotary_embdding_unpad.py	[Inference]Move benchmark-related code to the example directory. (#5408)	2024-02-28 16:46:03 +08:00
test_xine_copy.py	[Inference]Move benchmark-related code to the example directory. (#5408)	2024-02-28 16:46:03 +08:00