ColossalAI/colossalai
アマデウス 01a80cd86d
Hotfix/Colossalai layers (#92)
* optimized 1d layer apis; reorganized nn.layer modules; fixed tests

* fixed 2.5d runtime issue

* reworked split batch, now called in trainer.schedule.load_batch

Co-authored-by: BoxiangW <45734921+BoxiangW@users.noreply.github.com>
2021-12-29 23:32:10 +08:00
..
amp add interleaved pipeline, fix naive amp and update pipeline model initializer (#80) 2021-12-20 23:26:19 +08:00
builder add interleaved pipeline, fix naive amp and update pipeline model initializer (#80) 2021-12-20 23:26:19 +08:00
communication Layer integration (#83) 2021-12-27 15:04:32 +08:00
context Hotfix/Colossalai layers (#92) 2021-12-29 23:32:10 +08:00
engine Hotfix/Colossalai layers (#92) 2021-12-29 23:32:10 +08:00
kernel add colossalai kernel module (#55) 2021-12-21 12:19:52 +08:00
logging update examples and sphnix docs for the new api (#63) 2021-12-13 22:07:01 +08:00
nn Hotfix/Colossalai layers (#92) 2021-12-29 23:32:10 +08:00
registry Develop/experiments (#59) 2021-12-09 15:08:29 +08:00
trainer Hotfix/Colossalai layers (#92) 2021-12-29 23:32:10 +08:00
utils Hotfix/Colossalai layers (#92) 2021-12-29 23:32:10 +08:00
zero fixed zero level 3 dtype bug (#76) 2021-12-20 17:00:53 +08:00
__init__.py Develop/experiments (#59) 2021-12-09 15:08:29 +08:00
constants.py Hotfix/Colossalai layers (#92) 2021-12-29 23:32:10 +08:00
core.py Develop/experiments (#59) 2021-12-09 15:08:29 +08:00
initialize.py Layer integration (#83) 2021-12-27 15:04:32 +08:00