ColossalAI/tests/test_zero/test_low_level
LuGY cbac782254
[zero]fix zero ckptIO with offload (#4529)
* fix zero ckptio with offload

* fix load device

* saved tensors in ckpt should be on CPU

* fix unit test

* fix unit test

* add clear cache

* save memory for CI
2023-09-01 17:41:19 +08:00
..
test_grad_acc.py [zero]support zero2 with gradient accumulation (#4511) 2023-08-25 13:44:07 +08:00
test_zero1_2.py [hotfix] fix unsafe async comm in zero (#4404) 2023-08-11 15:09:24 +08:00
test_zero_ckpt.py [zero]fix zero ckptIO with offload (#4529) 2023-09-01 17:41:19 +08:00
test_zero_tp.py [gemini] improve compatibility and add static placement policy (#4479) 2023-08-24 09:29:25 +08:00