1 Commits (d4a64e355e4782b8c31d53fbcf0331289856f89c)

Author	SHA1	Message	Date
Jianghai	69cd7e069d	[Inference] ADD async and sync Api server using FastAPI (#5396) ... * add api server * fix * add * add completion service and fix bug * add generation config * revise shardformer * fix bugs * add docstrings and fix some bugs * fix bugs and add choices for prompt template	2024-05-08 15:18:28 +00:00