ColossalAI/colossalai/inference/quant/smoothquant/models
Xu Kai 785802e809
[inference] add reference and fix some bugs (#4937)
* add reference and fix some bugs

* update gptq init

---------

Co-authored-by: Xu Kai <xukai16@foxamil.com>
2023-10-20 13:39:34 +08:00
..
__init__.py [inference] Add smmoothquant for llama (#4904) 2023-10-16 11:28:44 +08:00
base_model.py [inference] add reference and fix some bugs (#4937) 2023-10-20 13:39:34 +08:00
linear.py [inference] add reference and fix some bugs (#4937) 2023-10-20 13:39:34 +08:00
llama.py [inference] add reference and fix some bugs (#4937) 2023-10-20 13:39:34 +08:00