ColossalAI/tests/test_zero/test_gemini
Hongxin Liu 50793b35f4
[gemini] accelerate inference (#3641)
* [gemini] support don't scatter after inference

* [chat] update colossalai strategy

* [chat] fix opt benchmark

* [chat] update opt benchmark

* [gemini] optimize inference

* [test] add gemini inference test

* [chat] fix unit test ci

* [chat] fix ci

* [chat] fix ci

* [chat] skip checkpoint test
2023-04-26 16:32:40 +08:00
..
test_chunk_mgrv2.py [test] refactor tests with spawn (#3452) 2023-04-06 14:51:35 +08:00
test_chunkv2.py [test] refactor tests with spawn (#3452) 2023-04-06 14:51:35 +08:00
test_fwd_bwd.py [gemini] accelerate inference (#3641) 2023-04-26 16:32:40 +08:00
test_gemini_use_rmt.py [test] refactor tests with spawn (#3452) 2023-04-06 14:51:35 +08:00
test_get_torch_model.py [test] refactor tests with spawn (#3452) 2023-04-06 14:51:35 +08:00
test_grad_clip.py [test] refactor tests with spawn (#3452) 2023-04-06 14:51:35 +08:00
test_inference.py [test] refactor tests with spawn (#3452) 2023-04-06 14:51:35 +08:00
test_optim.py [test] refactor tests with spawn (#3452) 2023-04-06 14:51:35 +08:00
test_runtime_mem_tracer.py [test] refactor tests with spawn (#3452) 2023-04-06 14:51:35 +08:00
test_search.py [test] refactor tests with spawn (#3452) 2023-04-06 14:51:35 +08:00
test_zeroddp_state_dict.py [test] refactor tests with spawn (#3452) 2023-04-06 14:51:35 +08:00
test_zeroddp_state_dict_shard.py [gemini] support save state dict in shards (#3581) 2023-04-17 17:11:09 +08:00
test_zerooptim_state_dict.py [test] refactor tests with spawn (#3452) 2023-04-06 14:51:35 +08:00