ColossalAI/colossalai/nn/optimizer
HELSON 7544347145
[MOE] add unitest for MOE experts layout, gradient handler and kernel (#469)
2022-03-21 13:35:04 +08:00
..
__init__.py [zero] cpu adam kernel (#288) 2022-03-11 15:50:28 +08:00
colossalai_optimizer.py
cpu_adam.py [test] make zero engine test really work (#447) 2022-03-17 17:24:25 +08:00
fused_adam.py [MOE] add unitest for MOE experts layout, gradient handler and kernel (#469) 2022-03-21 13:35:04 +08:00
fused_lamb.py [MOE] add unitest for MOE experts layout, gradient handler and kernel (#469) 2022-03-21 13:35:04 +08:00
fused_sgd.py
lamb.py
lars.py