Jianghai de378cd2ab [Inference] Finish Online Serving Test, add streaming output api, continuous batching test and example (#5432) ... * finish online test and add examples * fix test_contionus_batching * fix some bugs * fix bash * fix * fix inference * finish revision * fix typos * revision		2024-05-08 15:20:52 +00:00
..
jit	[npu] change device to accelerator api (#5239)	2024-01-09 10:20:05 +08:00
triton	[Inference] Finish Online Serving Test, add streaming output api, continuous batching test and example (#5432)	2024-05-08 15:20:52 +00:00
__init__.py	[feat] refactored extension module (#5298)	2024-01-25 17:01:48 +08:00
extensions	[feat] refactored extension module (#5298)	2024-01-25 17:01:48 +08:00
kernel_loader.py	[sync] resolve conflicts of merging main	2024-05-05 05:14:00 +00:00