ColossalAI/colossalai/zero/sharded_model
Jiarui Fang a444633d13
warmup ratio configration (#1192)
2022-06-30 15:23:50 +08:00
..
__init__.py [refactor] remove old zero code (#517) 2022-03-25 14:54:39 +08:00
_utils.py [gemini] add GeminiMemoryManger (#832) 2022-04-24 13:08:48 +08:00
reduce_scatter.py [zero] add sharded grad and refactor grad hooks for ShardedModel (#287) 2022-03-11 15:50:28 +08:00
sharded_model_v2.py warmup ratio configration (#1192) 2022-06-30 15:23:50 +08:00
utils.py [zero] refactor ShardedParamV2 for convenience (#742) 2022-04-13 14:54:26 +08:00