ColossalAI/colossalai/nn/parallel
Jiarui Fang ae7d3f4927
[refactor] move process group from _DistSpec to ColoTensor. (#1203)
2022-07-06 16:15:16 +08:00
..
layers [refactor] move process group from _DistSpec to ColoTensor. (#1203) 2022-07-06 16:15:16 +08:00
__init__.py [ddp] refactor ColoDDP and ZeroDDP (#1146) 2022-06-21 16:35:23 +08:00
data_parallel.py [Tensor] add cpu group to ddp (#1200) 2022-07-05 14:58:28 +08:00
reducer.py [ddp] ColoDDP uses bucket all-reduce (#1177) 2022-06-29 10:34:13 +08:00