ColossalAI/colossalai/inference/tensor_parallel/modeling
Jianghai ef4c14a5e2
[Inference] Fix bug in ChatGLM2 Tensor Parallelism (#5014)
* fix bug

* fix

* fix multiquery

* fix multiquery

---------

Co-authored-by: CjhHa1 <cjh18671720497outlook.com>
2023-11-07 15:01:50 +08:00
..
__init__.py
_utils.py
bloom.py
chatglm2.py [Inference] Fix bug in ChatGLM2 Tensor Parallelism (#5014) 2023-11-07 15:01:50 +08:00
llama.py [Pipeline Inference] Merge pp with tp (#4993) 2023-11-01 12:46:21 +08:00