ColossalAI/colossalai/inference/server
Jianghai 85946d4236
[Inference]Fix readme and example for API server (#5742)
* fix chatapi readme and example

* updating doc

* add an api and change the doc

* remove

* add credits and del 'API' heading

* readme

* readme
2024-05-24 10:03:05 +08:00
..
__init__.py [Inference] ADD async and sync Api server using FastAPI (#5396) 2024-05-08 15:18:28 +00:00
api_server.py [Inference]Fix readme and example for API server (#5742) 2024-05-24 10:03:05 +08:00
chat_service.py [Online Server] Chat Api for streaming and not streaming response (#5470) 2024-05-08 15:20:53 +00:00
completion_service.py [Inference] Fix API server, test and example (#5712) 2024-05-15 15:47:31 +08:00
utils.py [Online Server] Chat Api for streaming and not streaming response (#5470) 2024-05-08 15:20:53 +00:00