github
/
ColossalAI
mirror of https://github.com/hpcaitech/ColossalAI
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
ColossalAI/colossalai/inference/tensor_parallel/__init__.py

5 lines
123 B
Python
Raw Blame History

from .engine import TPInferEngine
from .kvcache_manager import MemoryManager
__all__ = ["MemoryManager", "TPInferEngine"]
Reference in New Issue View Git Blame Copy Permalink