Making large AI models cheaper, faster and more accessible
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
 
 
 
 
 
oahzxl ecccc91f21
[autochunk] support autochunk on evoformer (#2497)
2 years ago
..
components_to_test [testing] add beit model for unit testings (#2196) 2 years ago
test_amp [amp] add gradient clipping for unit tests (#2283) 2 years ago
test_auto_parallel [autoparallel] support origin activation ckpt on autoprallel system (#2468) 2 years ago
test_autochunk [autochunk] support autochunk on evoformer (#2497) 2 years ago
test_comm
test_config
test_context
test_data
test_data_pipeline_tensor_parallel
test_ddp [zero] add chunk init function for users (#1729) 2 years ago
test_device [device] find best logical mesh 2 years ago
test_engine
test_fx [Pipeline] Add Topo Class (#2059) 2 years ago
test_gemini [zero] fix state_dict and load_state_dict for ddp ignored parameters (#2443) 2 years ago
test_layers improved allgather & reducescatter for 3d 2 years ago
test_moe [test] align model name with the file name. (#2045) 2 years ago
test_ops
test_optimizer [setup] support pre-build and jit-build of cuda kernels (#2374) 2 years ago
test_pipeline [PP Middleware] Add bwd and step for PP middleware (#2111) 2 years ago
test_tensor [zero] add unit testings for hybrid parallelism (#2486) 2 years ago
test_trainer
test_utils updated attention kernel (#2133) 2 years ago
test_zero [zero] add unit testings for hybrid parallelism (#2486) 2 years ago
__init__.py