You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

char-1ee 5f398fc000 Pass inference model shard configs for module init ... Signed-off-by: char-1ee <xingjianli59@gmail.com>		6 months ago
..
__init__.py	…
async_engine.py	…
engine.py	Pass inference model shard configs for module init	6 months ago
plugin.py	…
request_handler.py	[Inference]Add Streaming LLM (#5745)	6 months ago
rpc_engine.py	[Inference] Fix Inference Generation Config and Sampling (#5710)	6 months ago