ColossalAI/colossalai/nn/parallel
Jiarui Fang 521078ffc9
[embedding] fix a bug in table wise sharding (#1538)
2022-09-02 15:48:35 +08:00
..
layers [embedding] fix a bug in table wise sharding (#1538) 2022-09-02 15:48:35 +08:00
__init__.py [ddp] refactor ColoDDP and ZeroDDP (#1146) 2022-06-21 16:35:23 +08:00
data_parallel.py [zero] ZeroDDP supports controlling outputs' dtype (#1399) 2022-08-02 17:49:11 +08:00
reducer.py [ddp] ColoDDP uses bucket all-reduce (#1177) 2022-06-29 10:34:13 +08:00