ColossalAI/examples/inference
Steve Luo 7806842f2d
add paged-attetionv2: support seq length split across thread block (#5707)
2024-05-14 12:46:54 +08:00
..
benchmark_ops add paged-attetionv2: support seq length split across thread block (#5707) 2024-05-14 12:46:54 +08:00
client [Inference] Add example test_ci script 2024-05-09 05:44:05 +00:00
llama [Fix] Fix Inference Example, Tests, and Requirements (#5688) 2024-05-08 11:30:15 +08:00