ColossalAI/colossalai/nn/optimizer
ver217 c415240db6
[nvme] CPUAdam and HybridAdam support NVMe offload (#1360)
* impl nvme optimizer

* update cpu adam

* add unit test

* update hybrid adam

* update docstr

* add TODOs

* update CI

* fix CI

* fix CI

* fix CI path

* fix CI path

* fix CI path

* fix install tensornvme

* fix CI

* fix CI path

* fix CI env variables

* test CI

* test CI

* fix CI

* fix nvme optim __del__

* fix adam __del__

* fix nvme optim

* fix CI env variables

* fix nvme optim import

* test CI

* test CI

* fix CI
2022-07-26 17:25:24 +08:00
..
__init__.py [Optimizer] Remove useless ColoOptimizer (#1312) 2022-07-14 16:57:48 +08:00
colossalai_optimizer.py [checkpoint] add ColoOptimizer checkpointing (#1316) 2022-07-15 09:52:55 +08:00
cpu_adam.py [nvme] CPUAdam and HybridAdam support NVMe offload (#1360) 2022-07-26 17:25:24 +08:00
fused_adam.py polish optimizer docstring (#619) 2022-04-01 16:27:03 +08:00
fused_lamb.py polish optimizer docstring (#619) 2022-04-01 16:27:03 +08:00
fused_sgd.py [optim] refactor fused sgd (#1134) 2022-06-20 11:19:38 +08:00
hybrid_adam.py [nvme] CPUAdam and HybridAdam support NVMe offload (#1360) 2022-07-26 17:25:24 +08:00
lamb.py [NFC] polish colossalai/nn/optimizer/lamb.py code style (#1275) 2022-07-13 12:08:21 +08:00
lars.py Fixed docstring in colossalai (#171) 2022-01-21 10:44:30 +08:00
nvme_optimizer.py [nvme] CPUAdam and HybridAdam support NVMe offload (#1360) 2022-07-26 17:25:24 +08:00
utils.py fix bugs in CPU adam (#633) 2022-04-02 17:04:05 +08:00