You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

ver217 6690a61b4d [hotfix] prevent nested ZeRO (#1140)		2 years ago
..
__init__.py	[refactor] remove old zero code (#517)	3 years ago
_utils.py	[gemini] add GeminiMemoryManger (#832)	3 years ago
reduce_scatter.py	[zero] add sharded grad and refactor grad hooks for ShardedModel (#287)	3 years ago
sharded_model_v2.py	[hotfix] prevent nested ZeRO (#1140)	2 years ago
utils.py	[zero] refactor ShardedParamV2 for convenience (#742)	3 years ago