Jiarui Fang 640a6cd304 [refactory] refactory the initialize method for new zero design (#431)		2022-03-16 19:29:37 +08:00
..
components_to_test	[zero] new interface for ShardedOptimv2 (#406)	2022-03-14 20:48:41 +08:00
test_amp	[polish] use GLOBAL_MODEL_DATA_TRACER (#417)	2022-03-15 11:29:46 +08:00
test_comm	…
test_config	…
test_context	…
test_data	…
test_data_pipeline_tensor_parallel	…
test_engine	[zero] new interface for ShardedOptimv2 (#406)	2022-03-14 20:48:41 +08:00
test_layers	…
test_moe	…
test_optimizer	[hotfix] run cpu adam unittest in pytest (#424)	2022-03-16 10:39:55 +08:00
test_trainer	[zero] new interface for ShardedOptimv2 (#406)	2022-03-14 20:48:41 +08:00
test_utils	[zero] memtracer to record cuda memory usage of model data and overall system (#395)	2022-03-14 22:05:30 +08:00
test_zero_data_parallel	[refactory] refactory the initialize method for new zero design (#431)	2022-03-16 19:29:37 +08:00
test_zero_tensor_parallel	…
__init__.py	…