ver217 a241f61b34 [zero] Update initialize for ZeRO (#458) ... * polish code * shard strategy receive pg in shard() / gather() * update zero engine * polish code		2022-03-18 16:18:31 +08:00
..
__init__.py	[zero] Update sharded model v2 using sharded param v2 (#323)	2022-03-11 15:50:28 +08:00
_base_ophook.py	add pytorch hooks (#179)	2022-01-25 22:20:54 +08:00
_memtracer_ophook.py	Flake8 code restyle	2022-03-11 15:50:28 +08:00
_shard_grad_ophook.py	[zero] add sharded grad and refactor grad hooks for ShardedModel (#287)	2022-03-11 15:50:28 +08:00
_shard_param_ophook.py	fix sharded param hook and unit test	2022-03-11 15:50:28 +08:00
zero_hook.py	[zero] Update initialize for ZeRO (#458)	2022-03-18 16:18:31 +08:00