You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

yuehuayingxueluo fa4fbdbffb adapted to pad_context_forward		11 months ago
..
test_models	[Inference] Pytorch Attention func, pad&nopad input support (#5219)	11 months ago
_utils.py	[Inference] Add the logic of the inference engine (#5173)	11 months ago
test_config_and_struct.py	fix bugs in sampler	11 months ago
test_inference_engine.py	adapted to pad_context_forward	11 months ago
test_kvcache_manager.py	[Inference] add logit processor and request handler (#5166)	11 months ago
test_request_handler.py	[Inference] add logit processor and request handler (#5166)	11 months ago