github
/
ColossalAI
mirror of https://github.com/hpcaitech/ColossalAI
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
ColossalAI/colossalai/nn/parallel/__init__.py

4 lines
78 B
Python
Raw Normal View History

[ddp] refactor ColoDDP and ZeroDDP (#1146) * ColoDDP supports overwriting default process group * rename ColoDDPV2 to ZeroDDP * add docstr for ZeroDDP * polish docstr
2022-06-21 08:35:23 +00:00
from .data_parallel import ColoDDP, ZeroDDP
[refactory] add nn.parallel module (#1068)
2022-06-06 07:34:41 +00:00
[ddp] refactor ColoDDP and ZeroDDP (#1146) * ColoDDP supports overwriting default process group * rename ColoDDPV2 to ZeroDDP * add docstr for ZeroDDP * polish docstr
2022-06-21 08:35:23 +00:00
__all__ = ['ColoDDP', 'ZeroDDP']