ColossalAI/colossalai/nn
ver217 6b2f2ab9bb
[ddp] ColoDDP uses bucket all-reduce (#1177)
* add reducer

* update colo ddp with reducer

* polish unit test

* polish unit test
2022-06-29 10:34:13 +08:00
..
_ops [tensor] revert local view back (#1178) 2022-06-27 18:38:34 +08:00
graph remove log (#1160) 2022-06-23 10:32:42 +08:00
layer [pipeline] refactor the pipeline module (#1087) 2022-06-10 11:27:38 +08:00
loss [hotfix] Raise messages for indivisible batch sizes with tensor parallelism (#622) 2022-04-02 16:12:04 +08:00
lr_scheduler Refactored docstring to google style 2022-03-29 17:17:47 +08:00
metric [hotfix] Raise messages for indivisible batch sizes with tensor parallelism (#622) 2022-04-02 16:12:04 +08:00
optimizer [optim] refactor fused sgd (#1134) 2022-06-20 11:19:38 +08:00
parallel [ddp] ColoDDP uses bucket all-reduce (#1177) 2022-06-29 10:34:13 +08:00
__init__.py [pipeline] refactor the pipeline module (#1087) 2022-06-10 11:27:38 +08:00
init.py Refactored docstring to google style 2022-03-29 17:17:47 +08:00