Baizhou Zhang 44eab2b27f [shardformer] support sharded checkpoint IO for models of HybridParallelPlugin (#4506) ... * add APIs * implement save_sharded_model * add test for hybrid checkpointio * implement naive loading for sharded model * implement efficient sharded model loading * open a new file for hybrid checkpoint_io * small fix * fix circular importing * fix docstring * arrange arguments and apis * small fix		2023-08-25 22:04:57 +08:00
..
__init__.py	[shardformer] support sharded checkpoint IO for models of HybridParallelPlugin (#4506)	2023-08-25 22:04:57 +08:00
checkpoint_io_base.py	Next commit [checkpointio] Unsharded Optimizer Checkpoint for Gemini Plugin (#4141)	2023-07-07 16:33:06 +08:00
general_checkpoint_io.py	[checkpointio] Sharded Optimizer Checkpoint for Gemini Plugin (#4302)	2023-07-21 14:39:01 +08:00
hybrid_parallel_checkpoint_io.py	[shardformer] support sharded checkpoint IO for models of HybridParallelPlugin (#4506)	2023-08-25 22:04:57 +08:00
index_file.py	[checkpointio] General Checkpointing of Sharded Optimizers (#3984)	2023-06-15 15:21:26 +08:00
utils.py	[shardformer] support sharded checkpoint IO for models of HybridParallelPlugin (#4506)	2023-08-25 22:04:57 +08:00