ver217 62b0a8d644 [zero] sharded optim support hybrid cpu adam (#486) ... * sharded optim support hybrid cpu adam * update unit test * polish docstring		2022-03-22 14:56:59 +08:00
..
__init__.py	Feature/zero (#279)	2022-03-11 15:50:28 +08:00
_zero3_utils.py	[zero] Update sharded model v2 using sharded param v2 (#323)	2022-03-11 15:50:28 +08:00
param_manager.py	Feature/zero (#279)	2022-03-11 15:50:28 +08:00
reduce_scatter.py	[zero] add sharded grad and refactor grad hooks for ShardedModel (#287)	2022-03-11 15:50:28 +08:00
sharded_grad.py	[zero] add sharded grad and refactor grad hooks for ShardedModel (#287)	2022-03-11 15:50:28 +08:00
sharded_model.py	[zero] Update sharded model v2 using sharded param v2 (#323)	2022-03-11 15:50:28 +08:00
sharded_model_v2.py	[zero] sharded optim support hybrid cpu adam (#486)	2022-03-22 14:56:59 +08:00
utils.py	[zero] polish sharded param name (#484)	2022-03-22 14:36:16 +08:00