ColossalAI/colossalai/shardformer/test/config.py

5 lines
93 B
Python

parallel = dict(
data=1,
pipeline=1,
tensor=dict(size=2, mode='1d')
)