github
/
ColossalAI
mirror of https://github.com/hpcaitech/ColossalAI
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
ColossalAI/colossalai/zero/shard_utils/__init__.py

6 lines
259 B
Python
Raw Normal View History

add bucket tensor shard strategy
2022-03-14 06:48:32 +00:00
from .base_shard_strategy import BaseShardStrategy
from .bucket_tensor_shard_strategy import BucketTensorShardStrategy
from .tensor_shard_strategy import TensorShardStrategy
[zero] a shard strategy in granularity of tensor (#307)
2022-03-04 03:59:35 +00:00
add bucket tensor shard strategy
2022-03-14 06:48:32 +00:00
__all__ = ['BaseShardStrategy', 'TensorShardStrategy', 'BucketTensorShardStrategy']