ColossalAI/tests
oahzxl 4953b4ace1
[autochunk] support evoformer tracer (#2485)
support full evoformer tracer, which is a main module of alphafold. previously we just support a simplifed version of it.
1. support some evoformer's op in fx
2. support evoformer test
3. add repos for test code
2023-01-16 19:25:05 +08:00
..
components_to_test [testing] add beit model for unit testings (#2196) 2022-12-26 17:35:36 +08:00
test_amp [amp] add gradient clipping for unit tests (#2283) 2023-01-04 11:59:56 +08:00
test_auto_parallel [autoparallel] support origin activation ckpt on autoprallel system (#2468) 2023-01-16 16:25:13 +08:00
test_autochunk [autochunk] support evoformer tracer (#2485) 2023-01-16 19:25:05 +08:00
test_comm [communication] add p2p_v2.py to support communication with List[Any] (#1407) 2022-08-09 11:40:04 +08:00
test_config [pipeline] refactor the pipeline module (#1087) 2022-06-10 11:27:38 +08:00
test_context [test] refactored with the new rerun decorator (#763) 2022-04-15 00:33:04 +08:00
test_data [unittest] refactored unit tests for change in dependency (#838) 2022-04-22 15:39:07 +08:00
test_data_pipeline_tensor_parallel [engin/schedule] use p2p_v2 to recontruct pipeline_schedule (#1408) 2022-08-12 11:33:26 +08:00
test_ddp [zero] add chunk init function for users (#1729) 2022-10-18 16:31:22 +08:00
test_device [device] find best logical mesh 2023-01-05 17:21:29 +08:00
test_engine [hotfix] remove potiential circle import (#1307) 2022-07-14 13:44:26 +08:00
test_fx [Pipeline] Add Topo Class (#2059) 2022-12-02 18:13:20 +08:00
test_gemini [zero] fix state_dict and load_state_dict for ddp ignored parameters (#2443) 2023-01-11 14:55:41 +08:00
test_layers improved allgather & reducescatter for 3d 2023-01-03 17:46:08 +08:00
test_moe [test] align model name with the file name. (#2045) 2022-11-30 15:45:26 +08:00
test_ops [FAW] export FAW in _ops (#1438) 2022-08-11 13:43:24 +08:00
test_optimizer [setup] support pre-build and jit-build of cuda kernels (#2374) 2023-01-06 20:50:26 +08:00
test_pipeline [PP Middleware] Add bwd and step for PP middleware (#2111) 2022-12-12 12:40:03 +08:00
test_tensor [polish] polish code for get_static_torch_model (#2405) 2023-01-09 17:41:38 +08:00
test_trainer [pipeline] refactor the pipeline module (#1087) 2022-06-10 11:27:38 +08:00
test_utils updated attention kernel (#2133) 2022-12-16 10:54:03 +08:00
test_zero [zero] add unit test for low-level zero init (#2474) 2023-01-15 10:42:01 +08:00
__init__.py