ColossalAI/tests
Jiarui Fang de0468c7a8 [zero] zero init context (#321)
* add zero init context

* add more flags for zero init context
fix bug of repeated converting param to ShardedParamV2

* polish code
2022-03-11 15:50:28 +08:00
..
test_comm
test_config
test_context
test_data
test_data_pipeline_tensor_parallel
test_engine/test_engine
test_layers
test_moe
test_optimizer [zero] cpu adam kernel (#288) 2022-03-11 15:50:28 +08:00
test_profiler Added profiler communication operations 2022-03-11 15:50:28 +08:00
test_trainer
test_utils
test_zero_data_parallel [zero] zero init context (#321) 2022-03-11 15:50:28 +08:00
test_zero_tensor_parallel