2 Commits (3e02154710f87942b1454b5dd826206c90f877f8)

Author	SHA1	Message	Date
Zhongkai Zhao	70885d707d	[hotfix] Suport extra_kwargs in ShardConfig (#5031) ... * [refactor]: replace inference args with extra_kwargs in ShardConfig * modify shardconfig * polish code * fix policy bug in llama * fix bug in auto policy * remove setattr in ShardConfig	2023-11-10 10:49:50 +08:00
Bin Jia	b6696beb04	[Pipeline Inference] Merge pp with tp (#4993) ... * refactor pipeline into new CaiInferEngine * updata llama modeling forward * merge tp with pp * update docstring * optimize test workflow and example * fix typo * add assert and todo	2023-11-01 12:46:21 +08:00