ColossalAI/colossalai/utils/multi_tensor_apply/__init__.py

4 lines
101 B
Python
Raw Normal View History

2021-10-28 16:21:23 +00:00
from .multi_tensor_apply import MultiTensorApply
multi_tensor_applier = MultiTensorApply(2048 * 32)