ColossalAI/tests/test_shardformer
flybird11111 3e02154710
[gemini] gemini support extra-dp (#5043)
* support ddp

* fix

* fix

* fix

fix

* support ddp

* fix

* fix

* fix

fix

* simplify tests

* fix

* fix

* fix

fix

fix

* fix
2023-11-16 21:03:04 +08:00
..
test_hybrid_parallel_grad_clip_norm [gemini] gemini support extra-dp (#5043) 2023-11-16 21:03:04 +08:00
test_layer [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
test_model [hotfix] Add layer norm gradients all-reduce for sequence parallel (#4926) 2023-11-03 13:32:43 +08:00
__init__.py [shardformer] adapted T5 and LLaMa test to use kit (#4049) 2023-07-04 16:05:01 +08:00
test_shard_utils.py [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
test_with_torch_ddp.py [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00