ColossalAI/colossalai/zero/sharded_model
ver217 7cfd6c827e
[zero] add load_state_dict for sharded model (#894)
* add load_state_dict for sharded model

* fix bug

* fix bug

* fix ckpt dtype and device

* support load state dict in zero init ctx

* fix bugs
2022-05-27 10:25:08 +08:00
..
__init__.py [refactor] remove old zero code (#517) 2022-03-25 14:54:39 +08:00
_utils.py [gemini] add GeminiMemoryManger (#832) 2022-04-24 13:08:48 +08:00
reduce_scatter.py [zero] add sharded grad and refactor grad hooks for ShardedModel (#287) 2022-03-11 15:50:28 +08:00
sharded_model_v2.py [zero] add load_state_dict for sharded model (#894) 2022-05-27 10:25:08 +08:00
utils.py [zero] refactor ShardedParamV2 for convenience (#742) 2022-04-13 14:54:26 +08:00