Commit Graph

5 Commits (8bcfe360fdae7ccec7051aaced48497519afc2f2)

Author SHA1 Message Date
Runyu Lu 18d67d0e8e
[Feat]Inference RPC Server Support (#5705)
7 months ago
yuehuayingxueluo de4bf3dedf
[Inference]Adapt repetition_penalty and no_repeat_ngram_size (#5708)
7 months ago
yuehuayingxueluo 9c2fe7935f
[Inference]Adapt temperature processing logic (#5689)
7 months ago
傅剑寒 e6496dd371
[Inference] Optimize request handler of llama (#5512)
8 months ago
Jianghai 0e616462a7 [Inference] add logit processor and request handler (#5166)
11 months ago