Baizhou Zhang 44eab2b27f [shardformer] support sharded checkpoint IO for models of HybridParallelPlugin (#4506) ... * add APIs * implement save_sharded_model * add test for hybrid checkpointio * implement naive loading for sharded model * implement efficient sharded model loading * open a new file for hybrid checkpoint_io * small fix * fix circular importing * fix docstring * arrange arguments and apis * small fix		2023-08-25 22:04:57 +08:00
..
test_gemini_checkpoint_io.py	[checkpointio] Sharded Optimizer Checkpoint for Gemini Plugin (#4302)	2023-07-21 14:39:01 +08:00
test_gemini_torch_compability.py	[checkpointio] Sharded Optimizer Checkpoint for Gemini Plugin (#4302)	2023-07-21 14:39:01 +08:00
test_general_checkpoint_io.py	[test] fixed codefactor format report (#4026)	2023-06-16 18:23:02 +08:00
test_hybrid_parallel_plugin_checkpoint_io.py	[shardformer] support sharded checkpoint IO for models of HybridParallelPlugin (#4506)	2023-08-25 22:04:57 +08:00
test_low_level_zero_checkpoint_io.py	[zero] support shard optimizer state dict of zero (#4194)	2023-07-31 22:13:29 +08:00
test_torch_ddp_checkpoint_io.py	[checkpointio] sharded optimizer checkpoint for DDP plugin (#4002)	2023-06-16 14:14:05 +08:00
test_torch_fsdp_checkpoint_io.py	[booster] torch fsdp fix ckpt (#3788)	2023-05-23 16:58:45 +08:00
utils.py	[plugin] a workaround for zero plugins' optimizer checkpoint (#3780)	2023-05-19 19:42:31 +08:00