Baizhou Zhang 44eab2b27f [shardformer] support sharded checkpoint IO for models of HybridParallelPlugin (#4506) ... * add APIs * implement save_sharded_model * add test for hybrid checkpointio * implement naive loading for sharded model * implement efficient sharded model loading * open a new file for hybrid checkpoint_io * small fix * fix circular importing * fix docstring * arrange arguments and apis * small fix		2023-08-25 22:04:57 +08:00
..
chunk	…
memory_tracer	…
__init__.py	…
colo_init_context.py	…
gemini_ddp.py	[shardformer] support sharded checkpoint IO for models of HybridParallelPlugin (#4506)	2023-08-25 22:04:57 +08:00
gemini_hook.py	…
gemini_mgr.py	…
gemini_optimizer.py	[gemini] fix tensor storage cleaning in state dict collection (#4396)	2023-08-10 15:36:46 +08:00
placement_policy.py	…
utils.py	…