ColossalAI/tests
LuGY cbac782254
[zero]fix zero ckptIO with offload (#4529)
* fix zero ckptio with offload

* fix load device

* saved tensors in ckpt should be on CPU

* fix unit test

* fix unit test

* add clear cache

* save memory for CI
2023-09-01 17:41:19 +08:00
..
components_to_test [CI] fix typo with tests/ etc. (#3727) 2023-05-11 16:30:58 +08:00
kit [gemini] improve compatibility and add static placement policy (#4479) 2023-08-24 09:29:25 +08:00
test_amp
test_analyzer [devops] update torch version of CI (#3725) 2023-05-15 17:20:56 +08:00
test_auto_parallel [gemini] fix argument naming during chunk configuration searching 2023-06-25 13:34:15 +08:00
test_autochunk [test] fixed tests failed due to dtensor change (#4082) 2023-07-04 16:05:01 +08:00
test_booster [gemini] improve compatibility and add static placement policy (#4479) 2023-08-24 09:29:25 +08:00
test_checkpoint_io [zero]fix zero ckptIO with offload (#4529) 2023-09-01 17:41:19 +08:00
test_cluster [cluster] add process group mesh (#4039) 2023-08-15 23:25:14 +08:00
test_comm
test_config
test_context
test_data
test_data_pipeline_tensor_parallel [gemini] improve compatibility and add static placement policy (#4479) 2023-08-24 09:29:25 +08:00
test_device [format] applied code formatting on changed files in pull request 4152 (#4157) 2023-07-04 16:07:47 +08:00
test_engine
test_fx [misc] resolve code factor issues (#4433) 2023-08-15 23:25:14 +08:00
test_kernels [Kernels] added triton-implemented of self attention for colossal-ai (#4241) 2023-07-18 23:53:38 +08:00
test_layers [CI] fix typo with tests/ etc. (#3727) 2023-05-11 16:30:58 +08:00
test_lazy [test] skip some not compatible models 2023-08-15 23:25:14 +08:00
test_moe [CI] fix typo with tests/ etc. (#3727) 2023-05-11 16:30:58 +08:00
test_optimizer [bf16] add bf16 support (#3882) 2023-06-05 15:58:31 +08:00
test_pipeline [gemini] improve compatibility and add static placement policy (#4479) 2023-08-24 09:29:25 +08:00
test_shardformer [gemini] improve compatibility and add static placement policy (#4479) 2023-08-24 09:29:25 +08:00
test_tensor [gemini] improve compatibility and add static placement policy (#4479) 2023-08-24 09:29:25 +08:00
test_trainer [CI] fix typo with tests/ etc. (#3727) 2023-05-11 16:30:58 +08:00
test_utils [gemini] improve compatibility and add static placement policy (#4479) 2023-08-24 09:29:25 +08:00
test_zero [zero]fix zero ckptIO with offload (#4529) 2023-09-01 17:41:19 +08:00
__init__.py