ColossalAI/tests/test_booster/test_plugin
Insu Jang 00525f7772
[shardformer] fix pipeline forward error if custom layer distribution is used (#5189)
* Use self.[distribute_layers|get_stage_index] to exploit custom layer distribution

* Change static methods for t5 layer distribution to member functions

* Change static methods for whisper layer distribution to member functions

* Replace whisper policy usage with self one

* Fix test case to use non-static layer distribution methods

* fix: fix typo

---------

Co-authored-by: Wenhao Chen <cwher@outlook.com>
2024-03-27 13:57:00 +08:00
..
test_3d_plugin.py [shardformer] fix pipeline forward error if custom layer distribution is used (#5189) 2024-03-27 13:57:00 +08:00
test_dp_plugin_base.py [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
test_gemini_plugin.py [devops] fix compatibility (#5444) 2024-03-13 15:24:13 +08:00
test_low_level_zero_plugin.py Merge branch 'main' into sync/npu 2024-01-18 12:05:21 +08:00
test_torch_ddp_plugin.py [workflow] fixed oom tests (#5275) 2024-01-16 18:55:13 +08:00
test_torch_fsdp_plugin.py [workflow] fixed oom tests (#5275) 2024-01-16 18:55:13 +08:00