You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
ColossalAI/tests/test_zero
Jiarui Fang 1fca5d79ea
[Gemini] remove GLOBAL_MODEL_DATA_TRACER (#2091)
2 years ago
..
low_level_zero [zero] test gradient accumulation (#1964) 2 years ago
common.py [moe] fix MoE bugs (#1628) 2 years ago
test_found_inf.py Revert "[zero] add ZeroTensorShardStrategy (#793)" (#806) 3 years ago
test_init_context.py [Gemini] remove GLOBAL_MODEL_DATA_TRACER (#2091) 2 years ago
test_mem_collector.py [Gemini] use MemStats to store the tracing data. Seperate it from Collector. (#2084) 2 years ago
test_shard_model_v2.py [test] align model name with the file name. (#2045) 2 years ago
test_shard_param.py [gemini] add GeminiMemoryManger (#832) 3 years ago
test_sharded_optim_state_dict.py [colotensor] add Tensor.view op and its unit test (#1343) 2 years ago
test_sharded_optim_v2.py [test] align model name with the file name. (#2045) 2 years ago
test_sharded_optim_with_sync_bn.py
test_state_dict.py [hotfix] shared model returns cpu state_dict (#1328) 2 years ago
test_tensor_utils.py [test] ignore 8 gpu test (#1080) 3 years ago
test_zero_engine.py