github
/
ColossalAI
mirror of https://github.com/hpcaitech/ColossalAI
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
ColossalAI/colossalai/zero/sharded_param/__init__.py

12 lines
780 B
Python
Raw Normal View History

[zero] sharded tensor (#305) * init shard param from shape tuple * add more unitest for shard param * add set_payload method for ShardedParam * [zero] add shareded tensor class * polish code
2022-03-04 02:46:13 +00:00
from colossalai.zero.sharded_param.sharded_tensor import ShardedTensor
[zero] polish sharded param name (#484) * [zero] polish sharded param name * polish code * polish * polish code * polish * polsih * polish
2022-03-22 06:36:16 +00:00
from colossalai.zero.sharded_param.sharded_param import ShardedParamV2
[refactor] zero directory (#724)
2022-04-11 15:13:02 +00:00
from colossalai.zero.sharded_param.tensor_utils import (colo_model_data_tensor_move, colo_model_data_tensor_move_inline,
colo_model_data_move_to_cpu, colo_model_tensor_clone,
colo_tensor_mem_usage)
from colossalai.zero.sharded_param.tensorful_state import TensorState, StatefulTensor
Polish sharded parameter (#297) * init shard param from shape tuple * add more unitest for shard param * add more unittests to shareded param
2022-03-03 04:42:57 +00:00
[refactor] zero directory (#724)
2022-04-11 15:13:02 +00:00
__all__ = [
'ShardedTensor', 'ShardedParamV2', 'colo_model_data_tensor_move', 'colo_model_data_tensor_move_inline',
'colo_model_data_move_to_cpu', 'colo_model_tensor_clone', 'colo_tensor_mem_usage', 'TensorState', 'StatefulTensor'
]