ColossalAI/tests
Jiarui Fang 660d2d1f1b
[Tensor] apply ColoTensor on Torch functions (#821)
* Revert "[zero] add ZeroTensorShardStrategy (#793)"

This reverts commit 88759e289e.

* [gemini] set cpu memory capacity

* [log] local throughput collecting

* polish

* polish

* polish

* polish code

* polish

* polish code

* add a new tensor structure and override linear for it

* polish

* polish

* polish

* polish

* polish

* polish

* polish

* polish

* polish

* polish

* polish

* [tensor] renaming and reorganize directory structure.

* rm useless dir

* polish

* polish

* [tensor] hander the function not wrapped
2022-04-21 14:21:10 +08:00
..
components_to_test [zero] adapt zero for unsharded paramters (Optimizer part) (#601) 2022-04-01 20:10:47 +08:00
test_amp [test] refactored with the new rerun decorator (#763) 2022-04-15 00:33:04 +08:00
test_comm [test] refactored with the new rerun decorator (#763) 2022-04-15 00:33:04 +08:00
test_config [test] removed trivial outdated test 2022-04-12 11:08:15 +08:00
test_context [test] refactored with the new rerun decorator (#763) 2022-04-15 00:33:04 +08:00
test_data [refactor] moving memtracer to gemini (#801) 2022-04-19 10:13:08 +08:00
test_data_pipeline_tensor_parallel [refactor] moving grad acc logic to engine (#804) 2022-04-19 14:03:21 +08:00
test_engine [refactor] moving grad acc logic to engine (#804) 2022-04-19 14:03:21 +08:00
test_gemini [tensor] reorganize files (#820) 2022-04-21 14:15:48 +08:00
test_layers [test] refactored with the new rerun decorator (#763) 2022-04-15 00:33:04 +08:00
test_moe [test] refactored with the new rerun decorator (#763) 2022-04-15 00:33:04 +08:00
test_optimizer [zero]added hybrid adam, removed loss scale in adam (#527) 2022-03-25 18:03:54 +08:00
test_tensor [Tensor] apply ColoTensor on Torch functions (#821) 2022-04-21 14:21:10 +08:00
test_trainer [test] refactored with the new rerun decorator (#763) 2022-04-15 00:33:04 +08:00
test_utils [refactor] moving grad acc logic to engine (#804) 2022-04-19 14:03:21 +08:00
test_zero Revert "[zero] add ZeroTensorShardStrategy (#793)" (#806) 2022-04-19 14:40:02 +08:00
__init__.py [zero] Update sharded model v2 using sharded param v2 (#323) 2022-03-11 15:50:28 +08:00