You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
ColossalAI/colossalai/nn/optimizer
ver217 104cbbb313
[hotfix] add hybrid adam to __init__ (#584)
3 years ago
..
__init__.py [hotfix] add hybrid adam to __init__ (#584) 3 years ago
colossalai_optimizer.py Develop/experiments (#59) 3 years ago
cpu_adam.py [docs] updatad docs of hybrid adam and cpu adam (#552) 3 years ago
fused_adam.py [docs] updatad docs of hybrid adam and cpu adam (#552) 3 years ago
fused_lamb.py [MOE] add unitest for MOE experts layout, gradient handler and kernel (#469) 3 years ago
fused_sgd.py refactor kernel (#142) 3 years ago
hybrid_adam.py [docs] updatad docs of hybrid adam and cpu adam (#552) 3 years ago
lamb.py Fixed docstring in colossalai (#171) 3 years ago
lars.py Fixed docstring in colossalai (#171) 3 years ago