yuehuayingxueluo 8c69debdc7 [Inference]Support vllm testing in benchmark scripts (#5379) ... * add vllm benchmark scripts * fix code style * update run_benchmark.sh * fix code style		2024-02-08 15:27:26 +08:00
..
__init__.py	[doc] updated inference readme (#5343)	2024-02-02 14:31:10 +08:00
engine.py	[Inference]Support vllm testing in benchmark scripts (#5379)	2024-02-08 15:27:26 +08:00
request_handler.py	[Inference] User Experience: update the logic of default tokenizer and generation config. (#5337)	2024-02-07 17:55:48 +08:00