ColossalAI/colossalai/nn/parallel
ver217 0c51ff2c13
[hotfix] ZeroDDP use new process group (#1333)
* process group supports getting ranks in group

* chunk mgr receives a process group

* update unit test

* fix unit tests
2022-07-18 14:14:52 +08:00
..
layers [hotfix] fix unit test test_module_spec (#1321) 2022-07-15 14:02:32 +08:00
__init__.py [ddp] refactor ColoDDP and ZeroDDP (#1146) 2022-06-21 16:35:23 +08:00
data_parallel.py [hotfix] ZeroDDP use new process group (#1333) 2022-07-18 14:14:52 +08:00
reducer.py [ddp] ColoDDP uses bucket all-reduce (#1177) 2022-06-29 10:34:13 +08:00