ColossalAI/colossalai/nn/optimizer
HELSON b31daed4cf
fix bugs in CPU adam (#633)
* add cpu adam counter for all cpu adam

* fixed updating error in adam kernel
2022-04-02 17:04:05 +08:00
..
__init__.py fix bugs in CPU adam (#633) 2022-04-02 17:04:05 +08:00
colossalai_optimizer.py
cpu_adam.py fix bugs in CPU adam (#633) 2022-04-02 17:04:05 +08:00
fused_adam.py polish optimizer docstring (#619) 2022-04-01 16:27:03 +08:00
fused_lamb.py polish optimizer docstring (#619) 2022-04-01 16:27:03 +08:00
fused_sgd.py polish optimizer docstring (#619) 2022-04-01 16:27:03 +08:00
hybrid_adam.py fix bugs in CPU adam (#633) 2022-04-02 17:04:05 +08:00
lamb.py
lars.py
utils.py fix bugs in CPU adam (#633) 2022-04-02 17:04:05 +08:00