Making large AI models cheaper, faster and more accessible
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
 
 
 
 
 
Jiarui Fang 27327a4c90
[example] add palm pytorch version (#2172)
2 years ago
..
components_to_test [Gemini] test step-tensor mapping using repeated_computed_layers.py (#2127) 2 years ago
test_amp [amp] add torch amp test (#1860) 2 years ago
test_auto_parallel [hotfix] fix aten default bug (#2158) 2 years ago
test_comm [communication] add p2p_v2.py to support communication with List[Any] (#1407) 2 years ago
test_config [pipeline] refactor the pipeline module (#1087) 2 years ago
test_context [test] refactored with the new rerun decorator (#763) 3 years ago
test_data [unittest] refactored unit tests for change in dependency (#838) 3 years ago
test_data_pipeline_tensor_parallel [engin/schedule] use p2p_v2 to recontruct pipeline_schedule (#1408) 2 years ago
test_ddp [zero] add chunk init function for users (#1729) 2 years ago
test_device [autoparallel] Add alpha beta (#1973) 2 years ago
test_engine [hotfix] remove potiential circle import (#1307) 2 years ago
test_fx [Pipeline] Add Topo Class (#2059) 2 years ago
test_gemini [example] add palm pytorch version (#2172) 2 years ago
test_layers [inference] overlap comm and compute in Linear1D_Row when stream_chunk_num > 1 (#1876) 2 years ago
test_moe [test] align model name with the file name. (#2045) 2 years ago
test_ops [FAW] export FAW in _ops (#1438) 2 years ago
test_optimizer [optimizer] add div_scale for optimizers (#2117) 2 years ago
test_pipeline [PP Middleware] Add bwd and step for PP middleware (#2111) 2 years ago
test_tensor [Gemini] remove static tracer (#2083) 2 years ago
test_trainer [pipeline] refactor the pipeline module (#1087) 2 years ago
test_utils updated attention kernel (#2133) 2 years ago
test_zero [hotfix] fix auto policy of test_sharded_optim_v2 (#2157) 2 years ago
__init__.py [zero] Update sharded model v2 using sharded param v2 (#323) 3 years ago