ColossalAI/colossalai/nn/layer/colossalai_layer
アマデウス 01a80cd86d
Hotfix/Colossalai layers (#92)
* optimized 1d layer apis; reorganized nn.layer modules; fixed tests

* fixed 2.5d runtime issue

* reworked split batch, now called in trainer.schedule.load_batch

Co-authored-by: BoxiangW <45734921+BoxiangW@users.noreply.github.com>
2021-12-29 23:32:10 +08:00
..
__init__.py Hotfix/Colossalai layers (#92) 2021-12-29 23:32:10 +08:00
_utils.py Hotfix/Colossalai layers (#92) 2021-12-29 23:32:10 +08:00
dropout.py Hotfix/Colossalai layers (#92) 2021-12-29 23:32:10 +08:00
embedding.py Hotfix/Colossalai layers (#92) 2021-12-29 23:32:10 +08:00
linear.py Hotfix/Colossalai layers (#92) 2021-12-29 23:32:10 +08:00
normalization.py Hotfix/Colossalai layers (#92) 2021-12-29 23:32:10 +08:00