ColossalAI/colossalai/nn/optimizer
LuGY a3269de5c9 [zero] cpu adam kernel (#288)
* Added CPU Adam

* finished the cpu adam

* updated the license

* delete useless parameters, removed resnet

* modified the method off cpu adam unittest

* deleted some useless codes

* removed useless codes

Co-authored-by: ver217 <lhx0217@gmail.com>
Co-authored-by: Frank Lee <somerlee.9@gmail.com>
Co-authored-by: jiaruifang <fangjiarui123@gmail.com>
2022-03-11 15:50:28 +08:00
..
__init__.py [zero] cpu adam kernel (#288) 2022-03-11 15:50:28 +08:00
colossalai_optimizer.py Develop/experiments (#59) 2021-12-09 15:08:29 +08:00
cpu_adam.py [zero] cpu adam kernel (#288) 2022-03-11 15:50:28 +08:00
fused_adam.py refactor kernel (#142) 2022-01-13 16:47:17 +08:00
fused_lamb.py Fixed docstring in colossalai (#171) 2022-01-21 10:44:30 +08:00
fused_sgd.py refactor kernel (#142) 2022-01-13 16:47:17 +08:00
lamb.py Fixed docstring in colossalai (#171) 2022-01-21 10:44:30 +08:00
lars.py Fixed docstring in colossalai (#171) 2022-01-21 10:44:30 +08:00