ColossalAI/tests/test_zero/test_gemini
Hongxin Liu ae02d4e4f7
[bf16] add bf16 support (#3882)
* [bf16] add bf16 support for fused adam (#3844)

* [bf16] fused adam kernel support bf16

* [test] update fused adam kernel test

* [test] update fused adam test

* [bf16] cpu adam and hybrid adam optimizers support bf16 (#3860)

* [bf16] implement mixed precision mixin and add bf16 support for low level zero (#3869)

* [bf16] add mixed precision mixin

* [bf16] low level zero optim support bf16

* [text] update low level zero test

* [text] fix low level zero grad acc test

* [bf16] add bf16 support for gemini (#3872)

* [bf16] gemini support bf16

* [test] update gemini bf16 test

* [doc] update gemini docstring

* [bf16] add bf16 support for plugins (#3877)

* [bf16] add bf16 support for legacy zero (#3879)

* [zero] init context support bf16

* [zero] legacy zero support bf16

* [test] add zero bf16 test

* [doc] add bf16 related docstring for legacy zero
2023-06-05 15:58:31 +08:00
..
test_chunk_mgrv2.py [test] refactor tests with spawn (#3452) 2023-04-06 14:51:35 +08:00
test_chunkv2.py [CI] fix typo with tests/ etc. (#3727) 2023-05-11 16:30:58 +08:00
test_fwd_bwd.py [gemini] accelerate inference (#3641) 2023-04-26 16:32:40 +08:00
test_gemini_use_rmt.py [test] refactor tests with spawn (#3452) 2023-04-06 14:51:35 +08:00
test_get_torch_model.py [test] refactor tests with spawn (#3452) 2023-04-06 14:51:35 +08:00
test_grad_clip.py [test] refactor tests with spawn (#3452) 2023-04-06 14:51:35 +08:00
test_inference.py [test] refactor tests with spawn (#3452) 2023-04-06 14:51:35 +08:00
test_optim.py [bf16] add bf16 support (#3882) 2023-06-05 15:58:31 +08:00
test_runtime_mem_tracer.py [test] refactor tests with spawn (#3452) 2023-04-06 14:51:35 +08:00
test_search.py [test] refactor tests with spawn (#3452) 2023-04-06 14:51:35 +08:00
test_zeroddp_state_dict.py [test] refactor tests with spawn (#3452) 2023-04-06 14:51:35 +08:00
test_zeroddp_state_dict_shard.py [booster] gemini plugin support shard checkpoint (#3610) 2023-05-05 14:37:21 +08:00
test_zerooptim_state_dict.py [test] refactor tests with spawn (#3452) 2023-04-06 14:51:35 +08:00