ColossalAI/tests/test_tensor
ver217 8106d7b8c7
[ddp] refactor ColoDDP and ZeroDDP (#1146)
* ColoDDP supports overwriting default process group

* rename ColoDDPV2 to ZeroDDP

* add docstr for ZeroDDP

* polish docstr
2022-06-21 16:35:23 +08:00
..
_utils [unit test] refactor test tensor (#1005) 2022-05-19 18:57:56 +08:00
test_addmm_tp.py [tensor] refactor parallel action (#1007) 2022-05-20 20:19:58 +08:00
test_chunk.py [gemini] gemini mgr supports "cpu" placement policy (#1118) 2022-06-15 15:05:19 +08:00
test_context.py [refactory] add nn.parallel module (#1068) 2022-06-06 15:34:41 +08:00
test_dist_spec_mgr.py fix dist spec mgr (#1045) 2022-05-31 12:14:39 +08:00
test_embedding_tp.py [tensor] refactor parallel action (#1007) 2022-05-20 20:19:58 +08:00
test_gpt.py [refactory] add nn.parallel module (#1068) 2022-06-06 15:34:41 +08:00
test_graph.py [tensor] refactor colo-tensor (#992) 2022-05-19 12:44:59 +08:00
test_hybrid_device.py [Tensor] 1d row embedding (#1075) 2022-06-08 12:04:59 +08:00
test_linear_tp.py [tensor] refactor parallel action (#1007) 2022-05-20 20:19:58 +08:00
test_model.py [Tensor] fix equal assert (#1091) 2022-06-09 17:36:15 +08:00
test_module_spec.py [refactory] add nn.parallel module (#1068) 2022-06-06 15:34:41 +08:00
test_op.py [tensor] refactor colo-tensor (#992) 2022-05-19 12:44:59 +08:00
test_parameter.py [Tensor] add Parameter inheritance for ColoParameter (#1041) 2022-05-30 17:23:44 +08:00
test_tensor.py [Tensor] add Parameter inheritance for ColoParameter (#1041) 2022-05-30 17:23:44 +08:00
test_zero_optim.py [ddp] refactor ColoDDP and ZeroDDP (#1146) 2022-06-21 16:35:23 +08:00