You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Guangyao Zhang 1c961b20f3 [ShardFormer] fix qwen2 sp (#5903)		5 months ago
..
chatglm2_6b	[pre-commit.ci] pre-commit autoupdate (#5572)	5 months ago
__init__.py	…
bert.py	[shardformer]delete xformers (#5859)	5 months ago
blip2.py	…
bloom.py	[Feature] Enable PP + SP for llama (#5868)	5 months ago
chatglm2.py	[ShardFormer] Add Ulysses Sequence Parallelism support for Command-R, Qwen2 and ChatGLM (#5897)	5 months ago
command.py	[ShardFormer] Add Ulysses Sequence Parallelism support for Command-R, Qwen2 and ChatGLM (#5897)	5 months ago
deepseek.py	[shardformer] DeepseekMoE support (#5871)	5 months ago
falcon.py	…
gpt2.py	[Feature] Enable PP + SP for llama (#5868)	5 months ago
gptj.py	…
jit.py	…
llama.py	[Feature] Enable PP + SP for llama (#5868)	5 months ago
mistral.py	[Feature] Enable PP + SP for llama (#5868)	5 months ago
mixtral.py	[MoE/ZeRO] Moe refactor with zero refactor (#5821)	5 months ago
opt.py	[Feature] Enable PP + SP for llama (#5868)	5 months ago
qwen2.py	[ShardFormer] fix qwen2 sp (#5903)	5 months ago
sam.py	[shardformer]delete xformers (#5859)	5 months ago
t5.py	…
vit.py	…
whisper.py	…