Bin Jia 48d0a58d10 add support for bloom (#5008)		2023-11-09 10:12:11 +08:00
..
test_dynamic_batching	[Inference] Dynamic Batching Inference, online and offline (#4953)	2023-10-30 10:52:19 +08:00
_utils.py	[misc] update pre-commit and run all files (#4752)	2023-09-19 14:20:26 +08:00
test_bloom_infer.py	[Kernels]Updated Triton kernels into 2.1.0 and adding flash-decoding for llama token attention (#4965)	2023-10-30 14:04:37 +08:00
test_chatglm2_infer.py	[Inference] Fix bug in ChatGLM2 Tensor Parallelism (#5014)	2023-11-07 15:01:50 +08:00
test_hybrid_bloom.py	add support for bloom (#5008)	2023-11-09 10:12:11 +08:00
test_hybrid_llama.py	[inference] support only TP (#4998)	2023-11-09 10:12:11 +08:00
test_infer_engine.py	[misc] update pre-commit and run all files (#4752)	2023-09-19 14:20:26 +08:00
test_kvcache_manager.py	[misc] update pre-commit and run all files (#4752)	2023-09-19 14:20:26 +08:00
test_llama2_infer.py	[Kernels]Updated Triton kernels into 2.1.0 and adding flash-decoding for llama token attention (#4965)	2023-10-30 14:04:37 +08:00
test_llama_infer.py	[Kernels]Updated Triton kernels into 2.1.0 and adding flash-decoding for llama token attention (#4965)	2023-10-30 14:04:37 +08:00