Insu Jang 00525f7772 [shardformer] fix pipeline forward error if custom layer distribution is used (#5189) ... * Use self.[distribute_layers|get_stage_index] to exploit custom layer distribution * Change static methods for t5 layer distribution to member functions * Change static methods for whisper layer distribution to member functions * Replace whisper policy usage with self one * Fix test case to use non-static layer distribution methods * fix: fix typo --------- Co-authored-by: Wenhao Chen <cwher@outlook.com>		2024-03-27 13:57:00 +08:00
..
models	[shardformer] fix pipeline forward error if custom layer distribution is used (#5189)	2024-03-27 13:57:00 +08:00
__init__.py	[moe] init mixtral impl	2024-02-07 19:21:02 +08:00
utils.py	[moe] support mixtral (#5309)	2024-02-07 19:21:02 +08:00