8 Commits (2d642eea0f92c7f7c1fb7bef3abdfdb0cb61d1bf)

Author	SHA1	Message	Date
hxwang	cb01c0d5ce	[moe] refactor mesh assignment	4 months ago
haze188	034020bd04	[misc] remove debug/print code	4 months ago
haze188	b2952a5982	[moe] deepseek moe sp support	4 months ago
hxwang	70c9924d0d	[chore] solve moe ckpt test failure and some other arg pass failure	4 months ago
hxwang	803878b2fd	[moe] full test for deepseek and mixtral (pp + sp to fix)	4 months ago
hxwang	877d94bb8c	[moe] init moe plugin comm setting with sp	4 months ago
hxwang	74eccac0db	[moe] test deepseek	4 months ago
Haze188	3420921101	[shardformer] DeepseekMoE support (#5871) ... * [Feature] deepseek moe expert parallel implement * [misc] fix typo, remove redundant file (#5867) * [misc] fix typo * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci --------- Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> * [Feature] deepseek support & unit test * [misc] remove debug code & useless print * [misc] fix typos (#5872) * [Feature] remove modeling file, use auto config. (#5884) * [misc] fix typos * [Feature] deepseek support via auto model, remove modeling file * [misc] delete useless file * [misc] fix typos * [Deepseek] remove redundant code (#5888) * [misc] fix typos * [Feature] deepseek support via auto model, remove modeling file * [misc] delete useless file * [misc] fix typos * [misc] remove redundant code * [Feature/deepseek] resolve comment. (#5889) * [misc] fix typos * [Feature] deepseek support via auto model, remove modeling file * [misc] delete useless file * [misc] fix typos * [misc] remove redundant code * [misc] mv module replacement into if branch * [misc] add some warning message and modify some code in unit test * [misc] fix typos --------- Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>	5 months ago