mirror of https://github.com/hpcaitech/ColossalAI
You can not select more than 25 topics
Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
20 lines
543 B
20 lines
543 B
3 years ago
|
colossalai.nn.optimizer
|
||
|
|
=======================
|
||
|
|
|
||
|
|
.. automodule:: colossalai.nn.optimizer
|
||
|
|
:members:
|
||
|
|
|
||
|
|
|
||
|
|
.. toctree::
|
||
|
|
:maxdepth: 2
|
||
|
|
|
||
|
|
colossalai.nn.optimizer.fp16_optimizer
|
||
|
|
colossalai.nn.optimizer.fused_adam
|
||
|
|
colossalai.nn.optimizer.fused_lamb
|
||
|
|
colossalai.nn.optimizer.fused_sgd
|
||
|
|
colossalai.nn.optimizer.lamb
|
||
|
|
colossalai.nn.optimizer.loss_scaler
|
||
|
|
colossalai.nn.optimizer.zero_redundancy_optimizer_level_1
|
||
|
|
colossalai.nn.optimizer.zero_redundancy_optimizer_level_2
|
||
|
|
colossalai.nn.optimizer.zero_redundancy_optimizer_level_3
|