ColossalAI/colossalai/tensor
Jiarui Fang 1aad903c15
[tensor] redistribute among different process groups (#1247)
* make it faster

* [tensor] rename convert_to_dist -> redistribute

* [tensor] ShardSpec and ReplicaSpec

* [tensor] redistribute among diff pgs

* polish code
2022-07-12 10:24:05 +08:00
..
__init__.py [tensor] a shorter shard and replicate spec (#1245) 2022-07-11 15:51:48 +08:00
colo_parameter.py [tensor] add zero_like colo op, important for Optimizer (#1236) 2022-07-08 14:55:27 +08:00
colo_tensor.py [tensor] redistribute among different process groups (#1247) 2022-07-12 10:24:05 +08:00
compute_spec.py [ColoTensor] rename APIs and add output_replicate to ComputeSpec (#1168) 2022-06-24 13:08:54 +08:00
const.py [Tensor] init ColoParameter (#914) 2022-05-06 12:57:14 +08:00
dist_spec_mgr.py [refactor] move process group from _DistSpec to ColoTensor. (#1203) 2022-07-06 16:15:16 +08:00
distspec.py [polish] polish __repr__ for ColoTensor, DistSpec, ProcessGroup (#1235) 2022-07-08 13:25:57 +08:00
op_wrapper.py [tensor] refactor colo-tensor (#992) 2022-05-19 12:44:59 +08:00
param_op_hook.py [refactor] move process group from _DistSpec to ColoTensor. (#1203) 2022-07-06 16:15:16 +08:00
process_group.py [tensor] redistribute among different process groups (#1247) 2022-07-12 10:24:05 +08:00
tensor_spec.py [refactor] move process group from _DistSpec to ColoTensor. (#1203) 2022-07-06 16:15:16 +08:00
utils.py reorgnize colotensor directory (#1062) 2022-06-03 18:04:22 +08:00