8 Commits (887d2d579b522cadab12571f2357d9e2cbd23aed)

Author	SHA1	Message	Date
Guangyao Zhang	669849d74b	[ShardFormer] Add Ulysses Sequence Parallelism support for Command-R, Qwen2 and ChatGLM (#5897)	2024-07-10 11:34:25 +08:00
GuangyaoZhang	d84d68601a	change 'xxx if xxx else None' to 'xxx or None'	2024-06-18 03:32:42 +00:00
GuangyaoZhang	a83a2336e8	rebase master llama change	2024-06-18 02:56:47 +00:00
GuangyaoZhang	363cde6957	merge model and attention forward	2024-06-18 02:32:41 +00:00
GuangyaoZhang	7a2b08646f	Remove CohereLayerNorm and use existing layernorm	2024-06-18 02:32:41 +00:00
GuangyaoZhang	fe2e74c03a	fix precommit	2024-06-18 02:31:33 +00:00
GuangyaoZhang	f656d61778	change command	2024-06-18 02:31:33 +00:00
GuangyaoZhang	0b81163bc0	Copy llama to command	2024-06-18 02:31:33 +00:00