ColossalAI/colossalai/zero/sharded_model
ver217 014bac0c49
[zero] hijack p.grad in sharded model (#554)
* hijack p.grad in sharded model

* polish comments

* polish comments
2022-03-30 18:14:50 +08:00
..
__init__.py [refactor] remove old zero code (#517) 2022-03-25 14:54:39 +08:00
_utils.py [zero] add stateful tensor (#549) 2022-03-30 13:51:37 +08:00
reduce_scatter.py [zero] add sharded grad and refactor grad hooks for ShardedModel (#287) 2022-03-11 15:50:28 +08:00
sharded_model_v2.py [zero] hijack p.grad in sharded model (#554) 2022-03-30 18:14:50 +08:00
utils.py [zero] polish sharded param name (#484) 2022-03-22 14:36:16 +08:00