Making large AI models cheaper, faster and more accessible
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
 
 
 
 
 
FrankLeeeee e88a498c9c [test] removed trivial outdated test 3 years ago
..
components_to_test [zero] adapt zero for unsharded paramters (Optimizer part) (#601) 3 years ago
test_amp [test] fixed rerun_on_exception and adapted test cases (#487) 3 years ago
test_comm [test] fixed rerun_on_exception and adapted test cases (#487) 3 years ago
test_config [test] removed trivial outdated test 3 years ago
test_context [test] fixed rerun_on_exception and adapted test cases (#487) 3 years ago
test_data [test] fixed rerun_on_exception and adapted test cases (#487) 3 years ago
test_data_pipeline_tensor_parallel [refactor] pipeline, put runtime schedule into engine. (#627) 3 years ago
test_engine [test] fixed rerun_on_exception and adapted test cases (#487) 3 years ago
test_layers [test] fixed rerun_on_exception and adapted test cases (#487) 3 years ago
test_moe [refactor] refactor the memory utils (#715) 3 years ago
test_optimizer [zero]added hybrid adam, removed loss scale in adam (#527) 3 years ago
test_trainer [refactor] pipeline, put runtime schedule into engine. (#627) 3 years ago
test_utils [test] added missing decorators to model checkpointing tests 3 years ago
test_zero_data_parallel [refactor] zero directory (#724) 3 years ago
__init__.py [zero] Update sharded model v2 using sharded param v2 (#323) 3 years ago