ColossalAI/colossalai/zero/shard_utils
Jiarui Fang c9e7d9582d [zero] polish shard strategy (#310)
* init shard param from shape tuple

* add more unitest for shard param

* add set_payload method for ShardedParam

* [zero] add shareded tensor class

* polish code

* add shard stratgy

* move shard and gather logic to shard strategy from shard tensor.

* polish code
2022-03-11 15:50:28 +08:00
..
__init__.py [zero] a shard strategy in granularity of tensor (#307) 2022-03-11 15:50:28 +08:00
base_shard_strategy.py [zero] a shard strategy in granularity of tensor (#307) 2022-03-11 15:50:28 +08:00
tensor_shard_strategy.py [zero] polish shard strategy (#310) 2022-03-11 15:50:28 +08:00