ColossalAI/colossalai/inference/modeling
Jianghai 1f8c7e7046
[Inference] User Experience: update the logic of default tokenizer and generation config. (#5337)
* add

* fix

* fix

* pause

* fix

* fix pytest

* align

* fix

* license

* fix

* fix

* fix readme

* fix some bugs

* remove tokenizer config
2024-02-07 17:55:48 +08:00
..
layers [Inference]Fused the gate and up proj in mlp,and optimized the autograd process. (#5365) 2024-02-06 19:38:25 +08:00
models [Inference] User Experience: update the logic of default tokenizer and generation config. (#5337) 2024-02-07 17:55:48 +08:00
policy [Fix/Infer] Remove unused deps and revise requirements (#5341) 2024-02-06 17:27:45 +08:00
__init__.py [doc] updated inference readme (#5343) 2024-02-02 14:31:10 +08:00