github
/
ColossalAI
mirror of https://github.com/hpcaitech/ColossalAI
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
ColossalAI/colossalai/zero/shard_utils/__init__.py

7 lines
350 B
Python
Raw Normal View History

add bucket tensor shard strategy
2022-03-14 06:48:32 +00:00
from .base_shard_strategy import BaseShardStrategy
from .bucket_tensor_shard_strategy import BucketTensorShardStrategy
from .tensor_shard_strategy import TensorShardStrategy
[zero] add ZeroTensorShardStrategy (#793)
2022-04-19 06:32:45 +00:00
from .zero_tensor_shard_strategy import ZeroTensorShardStrategy
[zero] a shard strategy in granularity of tensor (#307)
2022-03-04 03:59:35 +00:00
[zero] add ZeroTensorShardStrategy (#793)
2022-04-19 06:32:45 +00:00
__all__ = ['BaseShardStrategy', 'TensorShardStrategy', 'BucketTensorShardStrategy', 'ZeroTensorShardStrategy']