ColossalAI/tests/test_infer/test_kernels/cuda
Steve Luo 7806842f2d
add paged-attetionv2: support seq length split across thread block (#5707)
2024-05-14 12:46:54 +08:00
..
__init__.py [Fix] Fix & Update Inference Tests (compatibility w/ main) 2024-05-05 16:28:56 +00:00
test_convert_fp8.py [Inference/Feat] Add convert_fp8 op for fp8 test in the future (#5706) 2024-05-10 18:39:54 +08:00
test_flash_decoding_attention.py add paged-attetionv2: support seq length split across thread block (#5707) 2024-05-14 12:46:54 +08:00
test_get_cos_and_sin.py [Fix] Fix & Update Inference Tests (compatibility w/ main) 2024-05-05 16:28:56 +00:00
test_kv_cache_memcpy.py [Fix] Fix & Update Inference Tests (compatibility w/ main) 2024-05-05 16:28:56 +00:00
test_rms_layernorm.py [Fix] Fix & Update Inference Tests (compatibility w/ main) 2024-05-05 16:28:56 +00:00
test_rotary_embdding_unpad.py [Fix] Fix & Update Inference Tests (compatibility w/ main) 2024-05-05 16:28:56 +00:00
test_silu_and_mul.py [Fix] Fix & Update Inference Tests (compatibility w/ main) 2024-05-05 16:28:56 +00:00