Jianghai de378cd2ab [Inference] Finish Online Serving Test, add streaming output api, continuous batching test and example (#5432) ... * finish online test and add examples * fix test_contionus_batching * fix some bugs * fix bash * fix * fix inference * finish revision * fix typos * revision		2024-05-08 15:20:52 +00:00
..
locustfile.py	[Inference] Finish Online Serving Test, add streaming output api, continuous batching test and example (#5432)	2024-05-08 15:20:52 +00:00
run_locust.sh	[Inference] Finish Online Serving Test, add streaming output api, continuous batching test and example (#5432)	2024-05-08 15:20:52 +00:00