ColossalAI/colossalai/inference/executor
Yuanheng Zhao 283c407a19
[Inference] Fix Inference Generation Config and Sampling (#5710)
* refactor and add

* config default values

* fix gen config passing

* fix rpc generation config
2024-05-19 15:08:42 +08:00
..
rpc_worker.py [Inference] Fix Inference Generation Config and Sampling (#5710) 2024-05-19 15:08:42 +08:00