ver217 51b9a49655 [zero] add zero optimizer for ColoTensor (#1046) ... * add zero optimizer * torch ok * unit test ok * polish code * fix bugs * polish unit test * polish zero optim * polish colo ddp v2 * refactor folder structure * add comment * polish unit test * polish zero optim * polish unit test		2022-06-02 12:13:15 +08:00
..
_ops	[tensor] refactor parallel action (#1007)	2022-05-20 20:19:58 +08:00
graph	[Graph] building computing graph with ColoTensor, Linear only (#917)	2022-05-07 17:10:37 +08:00
modules	[Tensor] add module check and bert test (#1031)	2022-05-26 18:15:42 +08:00
optim	[Tensor] initialize the ColoOptimizer (#898)	2022-04-28 15:23:40 +08:00
__init__.py	[tensor] ColoTensor supports ZeRo (#1015)	2022-05-31 12:00:12 +08:00
chunk.py	[zero] add zero optimizer for ColoTensor (#1046)	2022-06-02 12:13:15 +08:00
colo_parameter.py	[tensor] ColoTensor supports ZeRo (#1015)	2022-05-31 12:00:12 +08:00
colo_tensor.py	[tensor] refactor parallel action (#1007)	2022-05-20 20:19:58 +08:00
const.py	[Tensor] init ColoParameter (#914)	2022-05-06 12:57:14 +08:00
dist_spec_mgr.py	fix dist spec mgr (#1045)	2022-05-31 12:14:39 +08:00
distspec.py	[Tensor] add module check and bert test (#1031)	2022-05-26 18:15:42 +08:00
module_utils.py	[Tensor] add module check and bert test (#1031)	2022-05-26 18:15:42 +08:00
op_wrapper.py	[tensor] refactor colo-tensor (#992)	2022-05-19 12:44:59 +08:00
param_op_hook.py	[tensor] ColoTensor supports ZeRo (#1015)	2022-05-31 12:00:12 +08:00
spec.py	[tensor] refactor parallel action (#1007)	2022-05-20 20:19:58 +08:00
utils.py	[Tensor] get named parameters for model using ColoTensors (#874)	2022-04-26 14:08:01 +08:00