Hongxin Liu f313babd11 [gemini] support save state dict in shards (#3581) ... * [gemini] support state dict shard * [gemini] add test state dict shard * [gemini] polish docstr * [gemini] fix merge * [gemini] polish code		2023-04-17 17:11:09 +08:00
..
components_to_test	[testing] add beit model for unit testings (#2196)	2022-12-26 17:35:36 +08:00
kit	[FX] refactor experimental tracer and adapt it with hf models (#3157)	2023-03-22 10:40:33 +08:00
test_amp	[test] refactor tests with spawn (#3452)	2023-04-06 14:51:35 +08:00
test_analyzer	[test] refactor tests with spawn (#3452)	2023-04-06 14:51:35 +08:00
test_auto_parallel	[test] refactor tests with spawn (#3452)	2023-04-06 14:51:35 +08:00
test_autochunk	[test] refactor tests with spawn (#3452)	2023-04-06 14:51:35 +08:00
test_booster	[gemini] gemini supports lazy init (#3379)	2023-04-12 16:03:25 +08:00
test_checkpoint_io	[checkpoint] support huggingface style sharded checkpoint (#3461)	2023-04-06 16:23:39 +08:00
test_cluster	[test] refactor tests with spawn (#3452)	2023-04-06 14:51:35 +08:00
test_comm	[test] refactor tests with spawn (#3452)	2023-04-06 14:51:35 +08:00
test_config	[pipeline] refactor the pipeline module (#1087)	2022-06-10 11:27:38 +08:00
test_context	[test] refactor tests with spawn (#3452)	2023-04-06 14:51:35 +08:00
test_data	[test] refactor tests with spawn (#3452)	2023-04-06 14:51:35 +08:00
test_data_pipeline_tensor_parallel	[test] refactor tests with spawn (#3452)	2023-04-06 14:51:35 +08:00
test_ddp	[test] refactor tests with spawn (#3452)	2023-04-06 14:51:35 +08:00
test_device	[test] refactor tests with spawn (#3452)	2023-04-06 14:51:35 +08:00
test_engine	[test] refactor tests with spawn (#3452)	2023-04-06 14:51:35 +08:00
test_fx	[test] refactor tests with spawn (#3452)	2023-04-06 14:51:35 +08:00
test_layers	[test] refactor tests with spawn (#3452)	2023-04-06 14:51:35 +08:00
test_moe	[test] refactor tests with spawn (#3452)	2023-04-06 14:51:35 +08:00
test_ops	[test] refactor tests with spawn (#3452)	2023-04-06 14:51:35 +08:00
test_optimizer	[test] refactor tests with spawn (#3452)	2023-04-06 14:51:35 +08:00
test_pipeline	[test] refactor tests with spawn (#3452)	2023-04-06 14:51:35 +08:00
test_tensor	[test] refactor tests with spawn (#3452)	2023-04-06 14:51:35 +08:00
test_trainer	[test] refactor tests with spawn (#3452)	2023-04-06 14:51:35 +08:00
test_utils	[test] refactor tests with spawn (#3452)	2023-04-06 14:51:35 +08:00
test_zero	[gemini] support save state dict in shards (#3581)	2023-04-17 17:11:09 +08:00
__init__.py	[zero] Update sharded model v2 using sharded param v2 (#323)	2022-03-11 15:50:28 +08:00