ver217 c415240db6 [nvme] CPUAdam and HybridAdam support NVMe offload (#1360) ... * impl nvme optimizer * update cpu adam * add unit test * update hybrid adam * update docstr * add TODOs * update CI * fix CI * fix CI * fix CI path * fix CI path * fix CI path * fix install tensornvme * fix CI * fix CI path * fix CI env variables * test CI * test CI * fix CI * fix nvme optim __del__ * fix adam __del__ * fix nvme optim * fix CI env variables * fix nvme optim import * test CI * test CI * fix CI		2022-07-26 17:25:24 +08:00
..
_ops	[colotensor] add Tensor.view op and its unit test (#1343)	2022-07-21 10:53:15 +08:00
graph	[refactor] move process group from _DistSpec to ColoTensor. (#1203)	2022-07-06 16:15:16 +08:00
layer	[NFC] polish colossalai/nn/layer/wrapper/pipeline_wrapper.py code style (#1303)	2022-07-13 19:01:07 +08:00
loss	[tensor] add unitest for colo_tensor 1DTP cross_entropy (#1230)	2022-07-07 19:17:23 +08:00
lr_scheduler	[NFC] polish colossalai/nn/lr_scheduler/onecycle.py code style (#1269)	2022-07-13 12:08:21 +08:00
metric	[hotfix] Raise messages for indivisible batch sizes with tensor parallelism (#622)	2022-04-02 16:12:04 +08:00
optimizer	[nvme] CPUAdam and HybridAdam support NVMe offload (#1360)	2022-07-26 17:25:24 +08:00
parallel	[colotensor] use cpu memory to store state_dict (#1367)	2022-07-26 14:13:38 +08:00
__init__.py	[pipeline] refactor the pipeline module (#1087)	2022-06-10 11:27:38 +08:00
init.py	[NFC] polish colossalai/nn/init.py code style (#1292)	2022-07-13 10:51:55 +08:00