You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
ColossalAI/colossalai/zero/sharded_model
HELSON 425b4a96b8
[gemini] polish stateful_tensor_mgr (#876)
3 years ago
..
__init__.py [refactor] remove old zero code (#517) 3 years ago
_utils.py [gemini] add GeminiMemoryManger (#832) 3 years ago
reduce_scatter.py [zero] add sharded grad and refactor grad hooks for ShardedModel (#287) 3 years ago
sharded_model_v2.py [gemini] polish stateful_tensor_mgr (#876) 3 years ago
utils.py [zero] refactor ShardedParamV2 for convenience (#742) 3 years ago