ColossalAI/colossalai
ver217 8f02a88db2
add interleaved pipeline, fix naive amp and update pipeline model initializer (#80)
2021-12-20 23:26:19 +08:00
..
amp add interleaved pipeline, fix naive amp and update pipeline model initializer (#80) 2021-12-20 23:26:19 +08:00
builder add interleaved pipeline, fix naive amp and update pipeline model initializer (#80) 2021-12-20 23:26:19 +08:00
communication add interleaved pipeline, fix naive amp and update pipeline model initializer (#80) 2021-12-20 23:26:19 +08:00
context add interleaved pipeline, fix naive amp and update pipeline model initializer (#80) 2021-12-20 23:26:19 +08:00
engine add interleaved pipeline, fix naive amp and update pipeline model initializer (#80) 2021-12-20 23:26:19 +08:00
logging update examples and sphnix docs for the new api (#63) 2021-12-13 22:07:01 +08:00
nn overlap computation and communication in 2d operations (#75) 2021-12-16 16:05:15 +08:00
registry Develop/experiments (#59) 2021-12-09 15:08:29 +08:00
trainer added CI for unit testing (#69) 2021-12-16 10:32:08 +08:00
utils add interleaved pipeline, fix naive amp and update pipeline model initializer (#80) 2021-12-20 23:26:19 +08:00
zero fixed zero level 3 dtype bug (#76) 2021-12-20 17:00:53 +08:00
__init__.py Develop/experiments (#59) 2021-12-09 15:08:29 +08:00
constants.py Develop/experiments (#59) 2021-12-09 15:08:29 +08:00
core.py Develop/experiments (#59) 2021-12-09 15:08:29 +08:00
initialize.py add interleaved pipeline, fix naive amp and update pipeline model initializer (#80) 2021-12-20 23:26:19 +08:00