9 Commits (2d642eea0f92c7f7c1fb7bef3abdfdb0cb61d1bf)

Author	SHA1	Message	Date
Hongxin Liu	9664b1bc19	[shardformer] hotfix attn mask (#5945)	4 months ago
Guangyao Zhang	669849d74b	[ShardFormer] Add Ulysses Sequence Parallelism support for Command-R, Qwen2 and ChatGLM (#5897)	5 months ago
Edenzzzz	fbf33ecd01	[Feature] Enable PP + SP for llama (#5868) ... * fix cross-PP-stage position id length diff bug * fix typo * fix typo * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * use a one cross entropy func for all shardformer models --------- Co-authored-by: Edenzzzz <wtan45@wisc.edu> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>	5 months ago
GuangyaoZhang	d84d68601a	change 'xxx if xxx else None' to 'xxx or None'	5 months ago
GuangyaoZhang	a83a2336e8	rebase master llama change	5 months ago
GuangyaoZhang	363cde6957	merge model and attention forward	5 months ago
GuangyaoZhang	fe2e74c03a	fix precommit	5 months ago
GuangyaoZhang	f656d61778	change command	5 months ago
GuangyaoZhang	0b81163bc0	Copy llama to command	5 months ago