You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
ColossalAI/colossalai/nn/optimizer
HELSON c7221cb2d4
[hotfix] adapt ProcessGroup and Optimizer to ColoTensor (#1388)
2 years ago
..
__init__.py [Optimizer] Remove useless ColoOptimizer (#1312) 2 years ago
colossalai_optimizer.py [checkpoint] add ColoOptimizer checkpointing (#1316) 2 years ago
cpu_adam.py [hotfix] adapt ProcessGroup and Optimizer to ColoTensor (#1388) 2 years ago
fused_adam.py [hotfix] adapt ProcessGroup and Optimizer to ColoTensor (#1388) 2 years ago
fused_lamb.py [hotfix] adapt ProcessGroup and Optimizer to ColoTensor (#1388) 2 years ago
fused_sgd.py [hotfix] adapt ProcessGroup and Optimizer to ColoTensor (#1388) 2 years ago
hybrid_adam.py [hotfix] adapt ProcessGroup and Optimizer to ColoTensor (#1388) 2 years ago
lamb.py [hotfix] adapt ProcessGroup and Optimizer to ColoTensor (#1388) 2 years ago
lars.py Fixed docstring in colossalai (#171) 3 years ago
nvme_optimizer.py [nvme] CPUAdam and HybridAdam support NVMe offload (#1360) 2 years ago
utils.py fix bugs in CPU adam (#633) 3 years ago