You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
ColossalAI/colossalai/nn/parallel
ver217 04c9a86af8
[zero] ZeroDDP supports controlling outputs' dtype (#1399)
2 years ago
..
layers [hotfix] fix unit test test_module_spec (#1321) 2 years ago
__init__.py [ddp] refactor ColoDDP and ZeroDDP (#1146) 2 years ago
data_parallel.py [zero] ZeroDDP supports controlling outputs' dtype (#1399) 2 years ago
reducer.py [ddp] ColoDDP uses bucket all-reduce (#1177) 2 years ago