ColossalAI/tests/test_tensor
HELSON 2d1a7dfe5f
[zero] add strict ddp mode (#2508)
* [zero] add strict ddp mode

* [polish] add comments for strict ddp mode

* [zero] fix test error
2023-01-20 14:04:38 +08:00
..
common_utils [zero] add unit testings for hybrid parallelism (#2486) 2023-01-18 10:36:10 +08:00
core
model [Gemini] remove static tracer (#2083) 2022-12-06 12:53:58 +08:00
test_colo_checkpoint_tools.py
test_comm_spec_apply.py
test_context.py
test_mix_gather.py
test_parameter.py
test_shape_consistency.py
test_shape_consistency_apply.py
test_sharded_linear.py
test_sharding_spec.py
test_tp_with_zero.py [zero] add strict ddp mode (#2508) 2023-01-20 14:04:38 +08:00