ColossalAI/colossalai/nn/optimizer
HELSON c7221cb2d4
[hotfix] adapt ProcessGroup and Optimizer to ColoTensor (#1388)
2022-07-29 19:33:24 +08:00
..
__init__.py [Optimizer] Remove useless ColoOptimizer (#1312) 2022-07-14 16:57:48 +08:00
colossalai_optimizer.py [checkpoint] add ColoOptimizer checkpointing (#1316) 2022-07-15 09:52:55 +08:00
cpu_adam.py [hotfix] adapt ProcessGroup and Optimizer to ColoTensor (#1388) 2022-07-29 19:33:24 +08:00
fused_adam.py [hotfix] adapt ProcessGroup and Optimizer to ColoTensor (#1388) 2022-07-29 19:33:24 +08:00
fused_lamb.py [hotfix] adapt ProcessGroup and Optimizer to ColoTensor (#1388) 2022-07-29 19:33:24 +08:00
fused_sgd.py [hotfix] adapt ProcessGroup and Optimizer to ColoTensor (#1388) 2022-07-29 19:33:24 +08:00
hybrid_adam.py [hotfix] adapt ProcessGroup and Optimizer to ColoTensor (#1388) 2022-07-29 19:33:24 +08:00
lamb.py [hotfix] adapt ProcessGroup and Optimizer to ColoTensor (#1388) 2022-07-29 19:33:24 +08:00
lars.py
nvme_optimizer.py [nvme] CPUAdam and HybridAdam support NVMe offload (#1360) 2022-07-26 17:25:24 +08:00
utils.py