ColossalAI/colossalai/zero/sharded_model
ver217 e396bb71f2
[zero] add tensor placement policies (#743)
* add tensor placement policies

* polish comments

* polish comments

* update moe unit tests
2022-04-13 15:00:48 +08:00
..
__init__.py [refactor] remove old zero code (#517) 2022-03-25 14:54:39 +08:00
_utils.py [zero] add stateful tensor (#549) 2022-03-30 13:51:37 +08:00
reduce_scatter.py [zero] add sharded grad and refactor grad hooks for ShardedModel (#287) 2022-03-11 15:50:28 +08:00
sharded_model_v2.py [zero] add tensor placement policies (#743) 2022-04-13 15:00:48 +08:00
utils.py [zero] refactor ShardedParamV2 for convenience (#742) 2022-04-13 14:54:26 +08:00