You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
ColossalAI/tests/test_optimizer
LuGY 105c5301c3
[zero]added hybrid adam, removed loss scale in adam (#527)
3 years ago
..
unittest_cpu_adam.py [zero]added hybrid adam, removed loss scale in adam (#527) 3 years ago
unittest_fused_adam.py [cuda] modify the fused adam, support hybrid of fp16 and fp32 (#497) 3 years ago
unittest_fused_adam_kernel.py [zero]added hybrid adam, removed loss scale in adam (#527) 3 years ago
unittest_hybrid_adam.py [zero]added hybrid adam, removed loss scale in adam (#527) 3 years ago