Jianghai bfd9b1b494 [Inference] Pytorch Attention func, pad&nopad input support (#5219) ... * add attn * add attention test * fix attn forward * fix decoding		2024-01-11 13:44:06 +00:00
..
test_models	[Inference] Pytorch Attention func, pad&nopad input support (#5219)	2024-01-11 13:44:06 +00:00
_utils.py	[Inference] Add the logic of the inference engine (#5173)	2024-01-11 13:39:56 +00:00
test_config_and_struct.py	fix bugs in sampler	2024-01-11 13:39:56 +00:00
test_inference_engine.py	fix bugs in sampler	2024-01-11 13:39:56 +00:00
test_kvcache_manager.py	[Inference] add logit processor and request handler (#5166)	2024-01-11 13:39:56 +00:00
test_request_handler.py	[Inference] add logit processor and request handler (#5166)	2024-01-11 13:39:56 +00:00