Commit Graph

2 Commits (48d0a58d10fa37f27f630a617dc61f5f5810f30c)

Author SHA1 Message Date
Bin Jia 48d0a58d10 add support for bloom (#5008) 2023-11-09 10:12:11 +08:00
Bin Jia b6696beb04
[Pipeline Inference] Merge pp with tp (#4993)
* refactor pipeline into new CaiInferEngine

* updata llama modeling forward

* merge tp with pp

* update docstring

* optimize test workflow and example

* fix typo

* add assert and todo
2023-11-01 12:46:21 +08:00