ColossalAI/colossalai/inference/core/__init__.py

5 lines
129 B
Python
Raw Normal View History

2024-02-02 06:31:10 +00:00
from .engine import InferenceEngine
from .request_handler import RequestHandler
__all__ = ["InferenceEngine", "RequestHandler"]