ver217 51b9a49655 [zero] add zero optimizer for ColoTensor (#1046) ... * add zero optimizer * torch ok * unit test ok * polish code * fix bugs * polish unit test * polish zero optim * polish colo ddp v2 * refactor folder structure * add comment * polish unit test * polish zero optim * polish unit test		2022-06-02 12:13:15 +08:00
..
__init__.py	[zero] add zero optimizer for ColoTensor (#1046)	2022-06-02 12:13:15 +08:00
colossalai_optimizer.py	Develop/experiments (#59)	2021-12-09 15:08:29 +08:00
cpu_adam.py	[zero] improve adaptability for not-shard parameters (#708)	2022-04-11 13:38:51 +08:00
fused_adam.py	polish optimizer docstring (#619)	2022-04-01 16:27:03 +08:00
fused_lamb.py	polish optimizer docstring (#619)	2022-04-01 16:27:03 +08:00
fused_sgd.py	polish optimizer docstring (#619)	2022-04-01 16:27:03 +08:00
hybrid_adam.py	fix bugs in CPU adam (#633)	2022-04-02 17:04:05 +08:00
lamb.py	Fixed docstring in colossalai (#171)	2022-01-21 10:44:30 +08:00
lars.py	Fixed docstring in colossalai (#171)	2022-01-21 10:44:30 +08:00
utils.py	fix bugs in CPU adam (#633)	2022-04-02 17:04:05 +08:00