ColossalAI/colossalai
アマデウス 0fedef4f3c
Layer integration (#83)
* integrated parallel layers for ease of building models

* integrated 2.5d layers

* cleaned codes and unit tests

* added log metric by step hook; updated imagenet benchmark; fixed some bugs

* reworked initialization; cleaned codes

Co-authored-by: BoxiangW <45734921+BoxiangW@users.noreply.github.com>
2021-12-27 15:04:32 +08:00
..
amp add interleaved pipeline, fix naive amp and update pipeline model initializer (#80) 2021-12-20 23:26:19 +08:00
builder add interleaved pipeline, fix naive amp and update pipeline model initializer (#80) 2021-12-20 23:26:19 +08:00
communication Layer integration (#83) 2021-12-27 15:04:32 +08:00
context Layer integration (#83) 2021-12-27 15:04:32 +08:00
engine add interleaved pipeline, fix naive amp and update pipeline model initializer (#80) 2021-12-20 23:26:19 +08:00
kernel add colossalai kernel module (#55) 2021-12-21 12:19:52 +08:00
logging update examples and sphnix docs for the new api (#63) 2021-12-13 22:07:01 +08:00
nn Layer integration (#83) 2021-12-27 15:04:32 +08:00
registry Develop/experiments (#59) 2021-12-09 15:08:29 +08:00
trainer Layer integration (#83) 2021-12-27 15:04:32 +08:00
utils Layer integration (#83) 2021-12-27 15:04:32 +08:00
zero fixed zero level 3 dtype bug (#76) 2021-12-20 17:00:53 +08:00
__init__.py Develop/experiments (#59) 2021-12-09 15:08:29 +08:00
constants.py Develop/experiments (#59) 2021-12-09 15:08:29 +08:00
core.py Develop/experiments (#59) 2021-12-09 15:08:29 +08:00
initialize.py Layer integration (#83) 2021-12-27 15:04:32 +08:00