ColossalAI/tests/test_zero_data_parallel
Jiarui Fang c11ff81b15
[zero] get memory usage of sharded optim v2. (#542)
2022-03-29 09:08:18 +08:00
..
common.py
test_init_context.py [zero] refactor model data tracing (#537) 2022-03-28 16:38:18 +08:00
test_shard_model_v2.py [zero] adapt for no-leaf module in zero (#535) 2022-03-28 17:42:18 +08:00
test_shard_param.py [zero] improve the accuracy of get_memory_usage of sharded param (#538) 2022-03-28 16:19:19 +08:00
test_sharded_optim_v2.py [zero] get memory usage of sharded optim v2. (#542) 2022-03-29 09:08:18 +08:00
test_sharded_optim_with_sync_bn.py
test_state_dict.py
test_zero_engine.py