Xu Kai 77a9328304 [inference] add llama2 support (#4898) ... * add llama2 support * fix multi group bug		2023-10-13 13:09:23 +08:00
..
_utils.py	[misc] update pre-commit and run all files (#4752)	2023-09-19 14:20:26 +08:00
test_bloom_infer.py	[infer] fix test bug (#4838)	2023-10-04 10:01:03 +08:00
test_chatglm2_infer.py	[infer] fix test bug (#4838)	2023-10-04 10:01:03 +08:00
test_infer_engine.py	[misc] update pre-commit and run all files (#4752)	2023-09-19 14:20:26 +08:00
test_kvcache_manager.py	[misc] update pre-commit and run all files (#4752)	2023-09-19 14:20:26 +08:00
test_llama2_infer.py	[inference] add llama2 support (#4898)	2023-10-13 13:09:23 +08:00
test_llama_infer.py	fix test llama (#4884)	2023-10-11 17:43:01 +08:00
test_pipeline_infer.py	[Pipeline Inference] Sync pipeline inference branch to main (#4820)	2023-10-11 11:40:06 +08:00