ColossalAI/colossalai/inference/core
Jianghai 1f8c7e7046
[Inference] User Experience: update the logic of default tokenizer and generation config. (#5337)
* add

* fix

* fix

* pause

* fix

* fix pytest

* align

* fix

* license

* fix

* fix

* fix readme

* fix some bugs

* remove tokenizer config
2024-02-07 17:55:48 +08:00
..
__init__.py [doc] updated inference readme (#5343) 2024-02-02 14:31:10 +08:00
engine.py [Inference] User Experience: update the logic of default tokenizer and generation config. (#5337) 2024-02-07 17:55:48 +08:00
request_handler.py [Inference] User Experience: update the logic of default tokenizer and generation config. (#5337) 2024-02-07 17:55:48 +08:00