ColossalAI/tests/test_legacy/test_context/configs/parallel_3d_init.py

5 lines
120 B
Python

#!/usr/bin/env python
# -*- encoding: utf-8 -*-
parallel = dict(pipeline=dict(size=2), tensor=dict(size=8, mode="3d"))