ColossalAI/colossalai/nn/parallel
ver217 8106d7b8c7
[ddp] refactor ColoDDP and ZeroDDP (#1146)
* ColoDDP supports overwriting default process group

* rename ColoDDPV2 to ZeroDDP

* add docstr for ZeroDDP

* polish docstr
2022-06-21 16:35:23 +08:00
..
layers [refactory] add nn.parallel module (#1068) 2022-06-06 15:34:41 +08:00
__init__.py [ddp] refactor ColoDDP and ZeroDDP (#1146) 2022-06-21 16:35:23 +08:00
data_parallel.py [ddp] refactor ColoDDP and ZeroDDP (#1146) 2022-06-21 16:35:23 +08:00