github
/
ColossalAI
mirror of https://github.com/hpcaitech/ColossalAI
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
ColossalAI/colossalai/inference/hybridengine
History
Bin Jia b6696beb04
[Pipeline Inference] Merge pp with tp (#4993) 
* refactor pipeline into new CaiInferEngine

* updata llama modeling forward

* merge tp with pp

* update docstring

* optimize test workflow and example

* fix typo

* add assert and todo
 		2023-11-01 12:46:21 +08:00
..
modeling [Pipeline Inference] Merge pp with tp (#4993) 2023-11-01 12:46:21 +08:00
polices [Pipeline Inference] Merge pp with tp (#4993) 2023-11-01 12:46:21 +08:00
__init__.py [Pipeline Inference] Merge pp with tp (#4993) 2023-11-01 12:46:21 +08:00
engine.py [Pipeline Inference] Merge pp with tp (#4993) 2023-11-01 12:46:21 +08:00