ColossalAI/tests
HELSON 5521af7877
[zero] fix state_dict and load_state_dict for ddp ignored parameters (#2443)
* [ddp] add is_ddp_ignored

[ddp] rename to is_ddp_ignored

* [zero] fix state_dict and load_state_dict

* fix bugs

* [zero] update unit test for ZeroDDP
2023-01-11 14:55:41 +08:00
..
components_to_test [testing] add beit model for unit testings (#2196) 2022-12-26 17:35:36 +08:00
test_amp [amp] add gradient clipping for unit tests (#2283) 2023-01-04 11:59:56 +08:00
test_auto_parallel [autoparallel] add shard option (#2423) 2023-01-11 13:40:33 +08:00
test_autochunk update doc 2023-01-10 12:29:09 +08:00
test_comm [communication] add p2p_v2.py to support communication with List[Any] (#1407) 2022-08-09 11:40:04 +08:00
test_config [pipeline] refactor the pipeline module (#1087) 2022-06-10 11:27:38 +08:00
test_context [test] refactored with the new rerun decorator (#763) 2022-04-15 00:33:04 +08:00
test_data [unittest] refactored unit tests for change in dependency (#838) 2022-04-22 15:39:07 +08:00
test_data_pipeline_tensor_parallel [engin/schedule] use p2p_v2 to recontruct pipeline_schedule (#1408) 2022-08-12 11:33:26 +08:00
test_ddp [zero] add chunk init function for users (#1729) 2022-10-18 16:31:22 +08:00
test_device [device] find best logical mesh 2023-01-05 17:21:29 +08:00
test_engine [hotfix] remove potiential circle import (#1307) 2022-07-14 13:44:26 +08:00
test_fx [Pipeline] Add Topo Class (#2059) 2022-12-02 18:13:20 +08:00
test_gemini [zero] fix state_dict and load_state_dict for ddp ignored parameters (#2443) 2023-01-11 14:55:41 +08:00
test_layers improved allgather & reducescatter for 3d 2023-01-03 17:46:08 +08:00
test_moe [test] align model name with the file name. (#2045) 2022-11-30 15:45:26 +08:00
test_ops [FAW] export FAW in _ops (#1438) 2022-08-11 13:43:24 +08:00
test_optimizer [setup] support pre-build and jit-build of cuda kernels (#2374) 2023-01-06 20:50:26 +08:00
test_pipeline [PP Middleware] Add bwd and step for PP middleware (#2111) 2022-12-12 12:40:03 +08:00
test_tensor [polish] polish code for get_static_torch_model (#2405) 2023-01-09 17:41:38 +08:00
test_trainer [pipeline] refactor the pipeline module (#1087) 2022-06-10 11:27:38 +08:00
test_utils updated attention kernel (#2133) 2022-12-16 10:54:03 +08:00
test_zero [testing] add beit model for unit testings (#2196) 2022-12-26 17:35:36 +08:00
__init__.py [zero] Update sharded model v2 using sharded param v2 (#323) 2022-03-11 15:50:28 +08:00