ColossalAI/colossalai/zero/sharded_model
ver217 9ec1ce6ab1
[zero] sharded model support the reuse of fp16 shard (#495)
* sharded model supports reuse fp16 shard

* rename variable

* polish code

* polish code

* polish code
2022-03-23 14:59:59 +08:00
..
__init__.py Feature/zero (#279) 2022-03-11 15:50:28 +08:00
_zero3_utils.py [zero] Update sharded model v2 using sharded param v2 (#323) 2022-03-11 15:50:28 +08:00
param_manager.py Feature/zero (#279) 2022-03-11 15:50:28 +08:00
reduce_scatter.py [zero] add sharded grad and refactor grad hooks for ShardedModel (#287) 2022-03-11 15:50:28 +08:00
sharded_grad.py [zero] add sharded grad and refactor grad hooks for ShardedModel (#287) 2022-03-11 15:50:28 +08:00
sharded_model.py [zero] Update sharded model v2 using sharded param v2 (#323) 2022-03-11 15:50:28 +08:00
sharded_model_v2.py [zero] sharded model support the reuse of fp16 shard (#495) 2022-03-23 14:59:59 +08:00
utils.py [zero] polish sharded param name (#484) 2022-03-22 14:36:16 +08:00