github
/
ColossalAI
mirror of https://github.com/hpcaitech/ColossalAI
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
ColossalAI/colossalai/inference/modeling
History
yuehuayingxueluo 5f00002e43
[Inference] Adapt Baichuan2-13B TP (#5659) 
* adapt to baichuan2 13B

* add baichuan2 13B TP

* update baichuan tp logic

* rm unused code

* Fix TP logic

* fix alibi slopes tp logic

* rm nn.Module

* Polished the code.

* change BAICHUAN_MODEL_NAME_OR_PATH

* Modified the logic for loading Baichuan weights.

* fix typos
 		2024-04-30 15:47:07 +08:00
..
layers [Inference] Adapt Baichuan2-13B TP (#5659) 2024-04-30 15:47:07 +08:00
models [Inference] Adapt Baichuan2-13B TP (#5659) 2024-04-30 15:47:07 +08:00
policy [Inference] Adapt Baichuan2-13B TP (#5659) 2024-04-30 15:47:07 +08:00
__init__.py [doc] updated inference readme (#5343) 2024-02-02 14:31:10 +08:00