ColossalAI/colossalai/zero/sharded_param
ver217 014bac0c49
[zero] hijack p.grad in sharded model (#554)
* hijack p.grad in sharded model

* polish comments

* polish comments
2022-03-30 18:14:50 +08:00
..
__init__.py [zero] polish sharded param name (#484) 2022-03-22 14:36:16 +08:00
sharded_param.py [zero] hijack p.grad in sharded model (#554) 2022-03-30 18:14:50 +08:00
sharded_tensor.py [zero] label state for param fp16 and grad (#551) 2022-03-30 15:57:46 +08:00
tensorful_state.py [zero] label state for param fp16 and grad (#551) 2022-03-30 15:57:46 +08:00