ColossalAI/tests
Xuanlei Zhao 2ca9728cbb
[autochunk] refactor chunk memory estimation (#2762)
* refact memory code

* dont log free var memory

* add memory align

* update chunk target

* update setting for new memory

* finish test

* update tracer

* update typo

* update test
2023-03-08 16:22:30 +08:00
..
components_to_test [testing] add beit model for unit testings (#2196) 2022-12-26 17:35:36 +08:00
test_amp [workflow] only report coverage for changed files (#2524) 2023-01-30 21:28:27 +08:00
test_auto_parallel [hotfix] skip auto checkpointing tests (#3029) 2023-03-07 15:50:00 +08:00
test_autochunk [autochunk] refactor chunk memory estimation (#2762) 2023-03-08 16:22:30 +08:00
test_comm [communication] add p2p_v2.py to support communication with List[Any] (#1407) 2022-08-09 11:40:04 +08:00
test_config [pipeline] refactor the pipeline module (#1087) 2022-06-10 11:27:38 +08:00
test_context [test] refactored with the new rerun decorator (#763) 2022-04-15 00:33:04 +08:00
test_data [unittest] refactored unit tests for change in dependency (#838) 2022-04-22 15:39:07 +08:00
test_data_pipeline_tensor_parallel [engin/schedule] use p2p_v2 to recontruct pipeline_schedule (#1408) 2022-08-12 11:33:26 +08:00
test_ddp [gemini] update ddp strict mode (#2518) 2023-01-28 14:35:25 +08:00
test_device [device] find best logical mesh 2023-01-05 17:21:29 +08:00
test_engine [hotfix] remove potiential circle import (#1307) 2022-07-14 13:44:26 +08:00
test_fx [hotfix] skip auto checkpointing tests (#3029) 2023-03-07 15:50:00 +08:00
test_gemini [hotfix] add correct device for fake_param (#2796) 2023-02-17 15:29:07 +08:00
test_layers improved allgather & reducescatter for 3d 2023-01-03 17:46:08 +08:00
test_moe [test] align model name with the file name. (#2045) 2022-11-30 15:45:26 +08:00
test_ops [FAW] export FAW in _ops (#1438) 2022-08-11 13:43:24 +08:00
test_optimizer [setup] support pre-build and jit-build of cuda kernels (#2374) 2023-01-06 20:50:26 +08:00
test_pipeline [PP Middleware] Add bwd and step for PP middleware (#2111) 2022-12-12 12:40:03 +08:00
test_tensor [DTensor] refactor CommSpec (#3034) 2023-03-08 10:45:31 +08:00
test_trainer [pipeline] refactor the pipeline module (#1087) 2022-06-10 11:27:38 +08:00
test_utils updated attention kernel (#2133) 2022-12-16 10:54:03 +08:00
test_zero [zero] add zero wrappers (#2523) 2023-01-29 17:52:58 +08:00
__init__.py [zero] Update sharded model v2 using sharded param v2 (#323) 2022-03-11 15:50:28 +08:00