ColossalAI/tests/test_shardformer
flybird11111 ec18fc7340
[shardformer] support pp+tp+zero1 tests (#4531)
* [shardformer] fix opt test hanging

* fix

* test

* test

* test

* fix test

* fix test

* remove print

* add fix

* [shardformer] pp+tp+zero1

[shardformer] pp+tp+zero1

[shardformer] pp+tp+zero1

[shardformer] pp+tp+zero1

[shardformer] pp+tp+zero1

[shardformer] pp+tp+zero1

* [shardformer] pp+tp+zero1

* [shardformer] pp+tp+zero1

* [shardformer] pp+tp+zero1

* [shardformer] pp+tp+zero1
2023-08-30 21:29:18 +08:00
..
test_layer [shardformer] Add overlap support for gpt2 (#4535) 2023-08-29 18:30:50 +08:00
test_model [shardformer] support pp+tp+zero1 tests (#4531) 2023-08-30 21:29:18 +08:00
__init__.py
test_shard_utils.py
test_with_torch_ddp.py