github
/
ColossalAI
mirror of https://github.com/hpcaitech/ColossalAI
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
ColossalAI/colossalai/inference/engine/__init__.py

4 lines
67 B
Python
Raw Normal View History

[inference] update examples and engine (#5073) * update examples and engine * fix choices * update example
2023-11-20 11:44:52 +00:00
from .engine import InferenceEngine
[Pipeline Inference] Merge pp with tp (#4993) * refactor pipeline into new CaiInferEngine * updata llama modeling forward * merge tp with pp * update docstring * optimize test workflow and example * fix typo * add assert and todo
2023-11-01 04:46:21 +00:00
[inference] update examples and engine (#5073) * update examples and engine * fix choices * update example
2023-11-20 11:44:52 +00:00
__all__ = ["InferenceEngine"]