Jianghai 9e2342bde2 [Hotfix] Fix bugs in testing continuous batching (#5270) ... * fix bug * fix bugs * fix bugs * fix bugs and add padding * add funcs and fix bugs * fix typos * fix bugs * add func		2024-01-18 16:31:14 +08:00
..
test_models	[Hotfix] Fix accuracy and align attention method api with Triton kernel (#5229)	2024-01-11 13:46:14 +00:00
_utils.py	[Inference] Add the logic of the inference engine (#5173)	2024-01-11 13:39:56 +00:00
test_config_and_struct.py	[Hotfix] Fix bugs in testing continuous batching (#5270)	2024-01-18 16:31:14 +08:00
test_inference_engine.py	[git] fixed rebased files	2024-01-11 13:50:45 +00:00
test_kvcache_manager.py	[Hotfix] Fix accuracy and align attention method api with Triton kernel (#5229)	2024-01-11 13:46:14 +00:00
test_request_handler.py	fix CI bugs	2024-01-11 13:46:14 +00:00