ColossalAI/tests/test_zero/test_gemini
Hongxin Liu 4f68b3f10c
[kernel] support pure fp16 for cpu adam and update gemini optim tests (#4921)
* [kernel] support pure fp16 for cpu adam (#4896)

* [kernel] fix cpu adam kernel for pure fp16 and update tests (#4919)

* [kernel] fix cpu adam

* [test] update gemini optim test
2023-10-16 21:56:53 +08:00
..
test_chunk_mgrv2.py [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
test_chunkv2.py [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
test_fwd_bwd.py [gemini] support amp o3 for gemini (#4872) 2023-10-12 10:39:08 +08:00
test_gemini_use_rmt.py [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
test_grad_clip.py [kernel] support pure fp16 for cpu adam and update gemini optim tests (#4921) 2023-10-16 21:56:53 +08:00
test_inference.py [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
test_optim.py [kernel] support pure fp16 for cpu adam and update gemini optim tests (#4921) 2023-10-16 21:56:53 +08:00
test_runtime_mem_tracer.py [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
test_search.py [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
test_zeroddp_state_dict.py [gemini] support amp o3 for gemini (#4872) 2023-10-12 10:39:08 +08:00
test_zerooptim_state_dict.py [hotfix] fix lr scheduler bug in torch 2.0 (#4864) 2023-10-12 14:04:24 +08:00