You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
ColossalAI/colossalai/inference/core
pre-commit-ci[bot] 7c2f79fa98
[pre-commit.ci] pre-commit autoupdate (#5572)
5 months ago
..
__init__.py [doc] updated inference readme (#5343) 10 months ago
async_engine.py [Inference] Fix API server, test and example (#5712) 7 months ago
engine.py [pre-commit.ci] pre-commit autoupdate (#5572) 5 months ago
plugin.py [Feat]Tensor Model Parallel Support For Inference (#5563) 8 months ago
request_handler.py [Inference]Add Streaming LLM (#5745) 6 months ago
rpc_engine.py [pre-commit.ci] pre-commit autoupdate (#5572) 5 months ago