ColossalAI/colossalai/context
アマデウス 0fedef4f3c
Layer integration (#83)
* integrated parallel layers for ease of building models

* integrated 2.5d layers

* cleaned codes and unit tests

* added log metric by step hook; updated imagenet benchmark; fixed some bugs

* reworked initialization; cleaned codes

Co-authored-by: BoxiangW <45734921+BoxiangW@users.noreply.github.com>
2021-12-27 15:04:32 +08:00
..
process_group_initializer Develop/experiments (#59) 2021-12-09 15:08:29 +08:00
random Migrated project 2021-10-28 18:21:23 +02:00
__init__.py Develop/experiments (#59) 2021-12-09 15:08:29 +08:00
config.py Develop/experiments (#59) 2021-12-09 15:08:29 +08:00
parallel_context.py Layer integration (#83) 2021-12-27 15:04:32 +08:00
parallel_mode.py Migrated project 2021-10-28 18:21:23 +02:00