github
/
ColossalAI
mirror of https://github.com/hpcaitech/ColossalAI
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
ColossalAI/colossalai/inference/core
History
Jianghai 61a1b2e798 [Inference] Fix bugs and docs for feat/online-server (#5598) 
* fix test bugs

* add do sample test

* del useless lines

* fix comments

* fix tests

* delete version tag

* delete version tag

* add

* del test sever

* fix test

* fix

* Revert "add"

This reverts commit b9305fb024.
 		2024-05-08 15:20:53 +00:00
..
__init__.py [doc] updated inference readme (#5343) 2024-02-02 14:31:10 +08:00
async_engine.py [Inference] Fix bugs and docs for feat/online-server (#5598) 2024-05-08 15:20:53 +00:00
engine.py [Inference] Fix bugs and docs for feat/online-server (#5598) 2024-05-08 15:20:53 +00:00
plugin.py [Feat]Tensor Model Parallel Support For Inference (#5563) 2024-04-18 16:56:46 +08:00
request_handler.py [Inference] Fix bugs and docs for feat/online-server (#5598) 2024-05-08 15:20:53 +00:00