ColossalAI/tests/test_checkpoint_io
Baizhou Zhang 44eab2b27f
[shardformer] support sharded checkpoint IO for models of HybridParallelPlugin (#4506)
* add APIs

* implement save_sharded_model

* add test for hybrid checkpointio

* implement naive loading for sharded model

* implement efficient sharded model loading

* open a new file for hybrid checkpoint_io

* small fix

* fix circular importing

* fix docstring

* arrange arguments and apis

* small fix
2023-08-25 22:04:57 +08:00
..
test_gemini_checkpoint_io.py [checkpointio] Sharded Optimizer Checkpoint for Gemini Plugin (#4302) 2023-07-21 14:39:01 +08:00
test_gemini_torch_compability.py [checkpointio] Sharded Optimizer Checkpoint for Gemini Plugin (#4302) 2023-07-21 14:39:01 +08:00
test_general_checkpoint_io.py [test] fixed codefactor format report (#4026) 2023-06-16 18:23:02 +08:00
test_hybrid_parallel_plugin_checkpoint_io.py [shardformer] support sharded checkpoint IO for models of HybridParallelPlugin (#4506) 2023-08-25 22:04:57 +08:00
test_low_level_zero_checkpoint_io.py [zero] support shard optimizer state dict of zero (#4194) 2023-07-31 22:13:29 +08:00
test_torch_ddp_checkpoint_io.py [checkpointio] sharded optimizer checkpoint for DDP plugin (#4002) 2023-06-16 14:14:05 +08:00
test_torch_fsdp_checkpoint_io.py
utils.py