ColossalAI/colossalai/nn/parallel
Jiarui Fang 04443605a5
[embedding] non-blocking cpu-gpu copy (#1647)
2022-09-26 14:57:57 +08:00
..
layers [embedding] non-blocking cpu-gpu copy (#1647) 2022-09-26 14:57:57 +08:00
__init__.py [ddp] refactor ColoDDP and ZeroDDP (#1146) 2022-06-21 16:35:23 +08:00
data_parallel.py Revert "[feature] new zero implementation (#1623)" (#1643) 2022-09-26 10:06:03 +08:00
reducer.py [ddp] ColoDDP uses bucket all-reduce (#1177) 2022-06-29 10:34:13 +08:00