You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

yuehuayingxueluo 5f00002e43 [Inference] Adapt Baichuan2-13B TP (#5659) ... * adapt to baichuan2 13B * add baichuan2 13B TP * update baichuan tp logic * rm unused code * Fix TP logic * fix alibi slopes tp logic * rm nn.Module * Polished the code. * change BAICHUAN_MODEL_NAME_OR_PATH * Modified the logic for loading Baichuan weights. * fix typos		7 months ago
..
__init__.py	[doc] updated inference readme (#5343)	10 months ago
attention.py	[Inference]Fused the gate and up proj in mlp，and optimized the autograd process. (#5365)	10 months ago
baichuan_tp_linear.py	[Inference] Adapt Baichuan2-13B TP (#5659)	7 months ago