ColossalAI/tests/test_zero_data_parallel
HELSON a30e2b4c24
[zero] adapt for no-leaf module in zero (#535)
only process module's own parameters in Zero context

add zero hooks for all modules that contrain parameters

gather parameters only belonging to module itself
2022-03-28 17:42:18 +08:00
..
common.py [zero] sharded model support the reuse of fp16 shard (#495) 2022-03-23 14:59:59 +08:00
test_init_context.py [zero] refactor model data tracing (#537) 2022-03-28 16:38:18 +08:00
test_shard_model_v2.py [zero] adapt for no-leaf module in zero (#535) 2022-03-28 17:42:18 +08:00
test_shard_param.py [zero] improve the accuracy of get_memory_usage of sharded param (#538) 2022-03-28 16:19:19 +08:00
test_sharded_optim_v2.py [zero] adapt for no-leaf module in zero (#535) 2022-03-28 17:42:18 +08:00
test_sharded_optim_with_sync_bn.py [test] fixed rerun_on_exception and adapted test cases (#487) 2022-03-25 17:25:12 +08:00
test_state_dict.py [test] fixed rerun_on_exception and adapted test cases (#487) 2022-03-25 17:25:12 +08:00
test_zero_engine.py [test] fixed rerun_on_exception and adapted test cases (#487) 2022-03-25 17:25:12 +08:00