ColossalAI/colossalai/nn
ver217 d26902645e
[ddp] add save/load state dict for ColoDDP (#1127)
* add save/load state dict for ColoDDP

* add unit test

* refactor unit test folder

* polish unit test

* rename unit test
2022-06-20 10:51:47 +08:00
..
_ops reorgnize colotensor directory (#1062) 2022-06-03 18:04:22 +08:00
layer [pipeline] refactor the pipeline module (#1087) 2022-06-10 11:27:38 +08:00
loss [hotfix] Raise messages for indivisible batch sizes with tensor parallelism (#622) 2022-04-02 16:12:04 +08:00
lr_scheduler Refactored docstring to google style 2022-03-29 17:17:47 +08:00
metric [hotfix] Raise messages for indivisible batch sizes with tensor parallelism (#622) 2022-04-02 16:12:04 +08:00
optimizer reorgnize colotensor directory (#1062) 2022-06-03 18:04:22 +08:00
parallel [ddp] add save/load state dict for ColoDDP (#1127) 2022-06-20 10:51:47 +08:00
__init__.py [pipeline] refactor the pipeline module (#1087) 2022-06-10 11:27:38 +08:00
init.py Refactored docstring to google style 2022-03-29 17:17:47 +08:00