8 Commits (318fbf1145d358ac3b4405ceb56954a94116d089)

Author	SHA1	Message	Date
ver217	367c615818	fix nvme docstring (#1450)	2022-08-12 18:01:02 +08:00
ver217	12b4887097	[hotfix] fix CPUAdam kernel nullptr (#1410)	2022-08-05 19:45:45 +08:00
HELSON	c7221cb2d4	[hotfix] adapt ProcessGroup and Optimizer to ColoTensor (#1388)	2022-07-29 19:33:24 +08:00
ver217	c415240db6	[nvme] CPUAdam and HybridAdam support NVMe offload (#1360) ... * impl nvme optimizer * update cpu adam * add unit test * update hybrid adam * update docstr * add TODOs * update CI * fix CI * fix CI * fix CI path * fix CI path * fix CI path * fix install tensornvme * fix CI * fix CI path * fix CI env variables * test CI * test CI * fix CI * fix nvme optim __del__ * fix adam __del__ * fix nvme optim * fix CI env variables * fix nvme optim import * test CI * test CI * fix CI	2022-07-26 17:25:24 +08:00
HELSON	b31daed4cf	fix bugs in CPU adam (#633) ... * add cpu adam counter for all cpu adam * fixed updating error in adam kernel	2022-04-02 17:04:05 +08:00
ver217	e619a651fb	polish optimizer docstring (#619)	2022-04-01 16:27:03 +08:00
LuGY	c44d797072	[docs] updatad docs of hybrid adam and cpu adam (#552)	2022-03-30 18:14:59 +08:00
LuGY	105c5301c3	[zero]added hybrid adam, removed loss scale in adam (#527) ... * [zero]added hybrid adam, removed loss scale of adam * remove useless code	2022-03-25 18:03:54 +08:00