ColossalAI/tests/test_zero_data_parallel
Jiarui Fang 3af13a2c3e [zero] polish ShardedOptimV2 unittest (#385)
* place params on cpu after zero init context

* polish code

* bucketzed cpu gpu tensor transter

* find a bug in sharded optim unittest

* add offload unittest for ShardedOptimV2.

* polish code and make it more robust
2022-03-11 15:50:28 +08:00
..
common.py [unit test] Refactored test cases with component func (#339) 2022-03-11 15:50:28 +08:00
test_init_context.py [zero] zero init context collect numel of model (#375) 2022-03-11 15:50:28 +08:00
test_shard_model_v2.py [zero] able to place params on cpu after zero init context (#365) 2022-03-11 15:50:28 +08:00
test_shard_param.py [unit test] Refactored test cases with component func (#339) 2022-03-11 15:50:28 +08:00
test_sharded_optim.py [unit test] Refactored test cases with component func (#339) 2022-03-11 15:50:28 +08:00
test_sharded_optim_v2.py [zero] polish ShardedOptimV2 unittest (#385) 2022-03-11 15:50:28 +08:00
test_sharded_optim_v2_with_cpu_adam.py [test] polish zero related unitest (#351) 2022-03-11 15:50:28 +08:00
test_sharded_optim_with_sync_bn.py [unit test] Refactored test cases with component func (#339) 2022-03-11 15:50:28 +08:00
test_state_dict.py [unit test] Refactored test cases with component func (#339) 2022-03-11 15:50:28 +08:00
test_zero_param_mgr.py using pytest parametrize 2022-03-11 15:50:28 +08:00