You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

haze188 7e737df5ad [misc] remove useless condition		4 months ago
..
__init__.py	…
auto_policy.py	[moe] test deepseek	4 months ago
base_policy.py	[shardformer] refactor pipeline grad ckpt config (#5646)	7 months ago
bert.py	[shardformer]delete xformers (#5859)	5 months ago
blip2.py	[Shardformer] add assert for num of attention heads divisible by tp_size (#5670)	7 months ago
bloom.py	[shardformer]delete xformers (#5859)	5 months ago
chatglm2.py	[ShardFormer] Add Ulysses Sequence Parallelism support for Command-R, Qwen2 and ChatGLM (#5897)	5 months ago
command.py	[ShardFormer] Add Ulysses Sequence Parallelism support for Command-R, Qwen2 and ChatGLM (#5897)	5 months ago
deepseek.py	[misc] fix ci failure: change default value to false in moe plugin	4 months ago
falcon.py	[Shardformer] Add parallel output for shardformer models(bloom, falcon) (#5702)	6 months ago
gpt2.py	change 'xxx if xxx else None' to 'xxx or None'	5 months ago
gptj.py	[shardformer] upgrade transformers to 4.39.3 (#5815)	5 months ago
llama.py	[Feature] Enable PP + SP for llama (#5868)	5 months ago
mistral.py	[shardformer] upgrade transformers to 4.39.3 (#5815)	5 months ago
mixtral.py	[misc] remove useless condition	4 months ago
opt.py	[pre-commit.ci] auto fixes from pre-commit.com hooks	7 months ago
qwen2.py	[ShardFormer] Add Ulysses Sequence Parallelism support for Command-R, Qwen2 and ChatGLM (#5897)	5 months ago
sam.py	[shardformer]delete xformers (#5859)	5 months ago
t5.py	[shardformer] Support the T5ForTokenClassification model (#5816)	5 months ago
vit.py	[Shardformer] add assert for num of attention heads divisible by tp_size (#5670)	7 months ago
whisper.py	[Shardformer] add assert for num of attention heads divisible by tp_size (#5670)	7 months ago