ColossalAI/tests/test_tensor
Jiarui Fang 1aad903c15
[tensor] redistribute among different process groups (#1247)
* make it faster

* [tensor] rename convert_to_dist -> redistribute

* [tensor] ShardSpec and ReplicaSpec

* [tensor] redistribute among diff pgs

* polish code
2022-07-12 10:24:05 +08:00
..
_utils [refactor] remove gpc dependency in colotensor's _ops (#1189) 2022-07-04 18:54:37 +08:00
test_addmm_tp.py [tensor] a shorter shard and replicate spec (#1245) 2022-07-11 15:51:48 +08:00
test_chunk.py [refactor] move chunk and chunkmgr to directory gemini (#1182) 2022-06-29 13:31:02 +08:00
test_context.py [refactory] add nn.parallel module (#1068) 2022-06-06 15:34:41 +08:00
test_dist_spec_mgr.py [tensor] a shorter shard and replicate spec (#1245) 2022-07-11 15:51:48 +08:00
test_embedding_bag_tp.py [tensor] a shorter shard and replicate spec (#1245) 2022-07-11 15:51:48 +08:00
test_embedding_tp.py [tensor] a shorter shard and replicate spec (#1245) 2022-07-11 15:51:48 +08:00
test_gpt.py [tensor] a shorter shard and replicate spec (#1245) 2022-07-11 15:51:48 +08:00
test_linear_tp.py [tensor] a shorter shard and replicate spec (#1245) 2022-07-11 15:51:48 +08:00
test_loss_func.py [tensor] a shorter shard and replicate spec (#1245) 2022-07-11 15:51:48 +08:00
test_model.py [tensor] a shorter shard and replicate spec (#1245) 2022-07-11 15:51:48 +08:00
test_module_spec.py [tensor] redistribute among different process groups (#1247) 2022-07-12 10:24:05 +08:00
test_op.py [tensor] redistribute among different process groups (#1247) 2022-07-12 10:24:05 +08:00
test_parameter.py [refactor] move process group from _DistSpec to ColoTensor. (#1203) 2022-07-06 16:15:16 +08:00
test_tensor.py [tensor] redistribute among different process groups (#1247) 2022-07-12 10:24:05 +08:00
test_zero_optim.py [tensor] a shorter shard and replicate spec (#1245) 2022-07-11 15:51:48 +08:00