You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
ColossalAI/tests/test_legacy/test_context/configs/parallel_2p5d_init.py

5 lines
131 B

#!/usr/bin/env python
# -*- encoding: utf-8 -*-
parallel = dict(pipeline=dict(size=2), tensor=dict(size=8, depth=2, mode="2.5d"))