ColossalAI/colossalai/communication
アマデウス 0fedef4f3c
Layer integration (#83)
* integrated parallel layers for ease of building models

* integrated 2.5d layers

* cleaned codes and unit tests

* added log metric by step hook; updated imagenet benchmark; fixed some bugs

* reworked initialization; cleaned codes

Co-authored-by: BoxiangW <45734921+BoxiangW@users.noreply.github.com>
2021-12-27 15:04:32 +08:00
..
__init__.py Layer integration (#83) 2021-12-27 15:04:32 +08:00
collective.py Layer integration (#83) 2021-12-27 15:04:32 +08:00
p2p.py add interleaved pipeline, fix naive amp and update pipeline model initializer (#80) 2021-12-20 23:26:19 +08:00
ring.py update examples and sphnix docs for the new api (#63) 2021-12-13 22:07:01 +08:00
utils.py add interleaved pipeline, fix naive amp and update pipeline model initializer (#80) 2021-12-20 23:26:19 +08:00