You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
ColossalAI/colossalai/nn/optimizer
ver217 f68eddfb3d
refactor kernel (#142)
3 years ago
..
__init__.py Develop/experiments (#59) 3 years ago
colossalai_optimizer.py Develop/experiments (#59) 3 years ago
fused_adam.py refactor kernel (#142) 3 years ago
fused_lamb.py refactor kernel (#142) 3 years ago
fused_sgd.py refactor kernel (#142) 3 years ago
lamb.py add an example of ViT-B/16 and remove w_norm clipping in LAMB (#29) 3 years ago
lars.py update documentation 3 years ago