ColossalAI/colossalai/nn/parallel
Jiatong Han 3263cdf57f [NFC] polish colossalai/nn/parallel/data_parallel.py code style (#1570)
Co-authored-by: JThh <jiatong.han@u.nus.edu>
2022-09-08 22:11:04 +08:00
..
layers [embedding] cache_embedding small improvement (#1564) 2022-09-08 16:41:19 +08:00
__init__.py [ddp] refactor ColoDDP and ZeroDDP (#1146) 2022-06-21 16:35:23 +08:00
data_parallel.py [NFC] polish colossalai/nn/parallel/data_parallel.py code style (#1570) 2022-09-08 22:11:04 +08:00
reducer.py [ddp] ColoDDP uses bucket all-reduce (#1177) 2022-06-29 10:34:13 +08:00