ColossalAI/tests/test_device
Kun Lin 8af29ee47a [shardformer] support vision transformer (#4096)
* first v of vit shardformer

* keep vit

* update

* vit shard add vitattention vitlayer

* update num head shard para

* finish test for vit

* add new_model_class & postprocess

* add vit readme

* delete old files & fix the conflict

* fix sth
2023-07-04 16:05:01 +08:00
..
test_alpha_beta.py [test] refactor tests with spawn (#3452) 2023-04-06 14:51:35 +08:00
test_device_mesh.py [shardformer] support vision transformer (#4096) 2023-07-04 16:05:01 +08:00
test_extract_alpha_beta.py [test] refactor tests with spawn (#3452) 2023-04-06 14:51:35 +08:00
test_init_logical_pg.py [test] fixed tests failed due to dtensor change (#4082) 2023-07-04 16:05:01 +08:00
test_search_logical_device_mesh.py [test] refactor tests with spawn (#3452) 2023-04-06 14:51:35 +08:00