ColossalAI/tests/test_optimizer
ver217 c415240db6
[nvme] CPUAdam and HybridAdam support NVMe offload (#1360)
* impl nvme optimizer

* update cpu adam

* add unit test

* update hybrid adam

* update docstr

* add TODOs

* update CI

* fix CI

* fix CI

* fix CI path

* fix CI path

* fix CI path

* fix install tensornvme

* fix CI

* fix CI path

* fix CI env variables

* test CI

* test CI

* fix CI

* fix nvme optim __del__

* fix adam __del__

* fix nvme optim

* fix CI env variables

* fix nvme optim import

* test CI

* test CI

* fix CI
2022-07-26 17:25:24 +08:00
..
test_nvme.py [nvme] CPUAdam and HybridAdam support NVMe offload (#1360) 2022-07-26 17:25:24 +08:00
unittest_cpu_adam.py [zero]added hybrid adam, removed loss scale in adam (#527) 2022-03-25 18:03:54 +08:00
unittest_fused_adam.py [cuda] modify the fused adam, support hybrid of fp16 and fp32 (#497) 2022-03-25 14:15:53 +08:00
unittest_fused_adam_kernel.py [zero]added hybrid adam, removed loss scale in adam (#527) 2022-03-25 18:03:54 +08:00
unittest_hybrid_adam.py [zero]added hybrid adam, removed loss scale in adam (#527) 2022-03-25 18:03:54 +08:00