ColossalAI/colossalai/inference/core
Jianghai 93aeacca34 [Inference]Update inference config and fix test (#5178)
* unify the config setting

* fix test

* fix import

* fix test

* fix

* fix

* add logger

* revise log info

---------

Co-authored-by: CjhHa1 <cjh18671720497outlook.com>
2024-01-11 13:39:29 +00:00
..
engine.py [Inference]Update inference config and fix test (#5178) 2024-01-11 13:39:29 +00:00
request_handler.py [Inference] Add readme (roadmap) and fulfill request handler (#5147) 2024-01-11 13:39:29 +00:00