ColossalAI/colossalai/zero/utils
ver217 51b9a49655
[zero] add zero optimizer for ColoTensor (#1046)
* add zero optimizer

* torch ok

* unit test ok

* polish code

* fix bugs

* polish unit test

* polish zero optim

* polish colo ddp v2

* refactor folder structure

* add comment

* polish unit test

* polish zero optim

* polish unit test
2022-06-02 12:13:15 +08:00
..
__init__.py [gemini] init genimi individual directory (#754) 2022-04-14 16:40:26 +08:00
zero_hook.py [gemini] accelerate adjust_layout() (#878) 2022-04-26 18:08:31 +08:00
zero_hook_v2.py [zero] add zero optimizer for ColoTensor (#1046) 2022-06-02 12:13:15 +08:00