1 Commits (5f8c0a0ac3b52a71b664c3e36dd1a8cef40f428d)

Author	SHA1	Message	Date
Jianghai	69cd7e069d	[Inference] ADD async and sync Api server using FastAPI (#5396) ... * add api server * fix * add * add completion service and fix bug * add generation config * revise shardformer * fix bugs * add docstrings and fix some bugs * fix bugs and add choices for prompt template	2024-05-08 15:18:28 +00:00