github
/
ColossalAI
mirror of https://github.com/hpcaitech/ColossalAI
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
ColossalAI/colossalai/inference/hybridengine
History
Zhongkai Zhao 70885d707d
[hotfix] Suport extra_kwargs in ShardConfig (#5031) 
* [refactor]: replace inference args with extra_kwargs in ShardConfig

* modify shardconfig

* polish code

* fix policy bug in llama

* fix bug in auto policy

* remove setattr in ShardConfig
 		2023-11-10 10:49:50 +08:00
..
modeling [Pipeline Inference] Merge pp with tp (#4993) 2023-11-01 12:46:21 +08:00
polices [hotfix] Suport extra_kwargs in ShardConfig (#5031) 2023-11-10 10:49:50 +08:00
__init__.py [Pipeline Inference] Merge pp with tp (#4993) 2023-11-01 12:46:21 +08:00
engine.py [Pipeline Inference] Merge pp with tp (#4993) 2023-11-01 12:46:21 +08:00