ColossalAI/tests
Ziyue Jiang b0936e4a44
[rpc] split with dag (#2028)
* add DAG to split_module

* add comment

* add test case for DAG

* remove print

* add DAG middleware in scheduler

* add test case for scheduler

* remove break

* recover old lifecycle

Co-authored-by: Ziyue Jiang <ziyue.jiang@gmail.com>
2022-11-29 11:36:28 +08:00
..
components_to_test [Gemini] more rigorous unit tests for run_fwd_bwd (#2034) 2022-11-29 09:26:06 +08:00
test_amp
test_auto_parallel [autoparallel] add split handler (#2032) 2022-11-29 11:03:51 +08:00
test_comm
test_config
test_context
test_data
test_data_pipeline_tensor_parallel
test_ddp
test_device [autoparallel] Add alpha beta (#1973) 2022-11-17 16:01:14 +08:00
test_engine [hotfix] remove potiential circle import (#1307) 2022-07-14 13:44:26 +08:00
test_fx [fx]Split partition with DAG information (#2025) 2022-11-25 17:42:48 +08:00
test_gemini [hotfix] add bert test for gemini fwd bwd (#2035) 2022-11-29 11:19:52 +08:00
test_layers
test_moe
test_ops
test_optimizer [kernel] move all symlinks of kernel to `colossalai._C` (#1971) 2022-11-17 13:42:33 +08:00
test_pipeline [rpc] split with dag (#2028) 2022-11-29 11:36:28 +08:00
test_tensor [Gemini] add unitests to check gemini correctness (#2015) 2022-11-24 16:51:45 +08:00
test_trainer
test_utils updated flash attention api 2022-11-15 15:25:39 +08:00
test_zero [Gemini] add bert for MemtracerWrapper unintests (#1982) 2022-11-18 14:58:28 +08:00
__init__.py