You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

ver217 fce9432f08 sync before creating empty grad		3 years ago
..
components_to_test	[zero] new interface for ShardedOptimv2 (#406)	3 years ago
test_amp	[polish] use GLOBAL_MODEL_DATA_TRACER (#417)	3 years ago
test_comm	Hotfix/Colossalai layers (#92)	3 years ago
test_config	[profiler] primary memory tracer	3 years ago
test_context	Optimize pipeline schedule (#94)	3 years ago
test_data	…
test_data_pipeline_tensor_parallel	Optimize pipeline schedule (#94)	3 years ago
test_engine	[zero] new interface for ShardedOptimv2 (#406)	3 years ago
test_layers	fixed padding index issue for vocab parallel embedding layers; updated 3D linear to be compatible with examples in the tutorial	3 years ago
test_moe	Added TPExpert for special situation	3 years ago
test_optimizer	[hotfix] run cpu adam unittest in pytest (#424)	3 years ago
test_trainer	[zero] new interface for ShardedOptimv2 (#406)	3 years ago
test_utils	[zero] memtracer to record cuda memory usage of model data and overall system (#395)	3 years ago
test_zero_data_parallel	sync before creating empty grad	3 years ago
test_zero_tensor_parallel	Feature/zero (#279)	3 years ago
__init__.py	[zero] Update sharded model v2 using sharded param v2 (#323)	3 years ago