Guangyao Zhang 1c961b20f3 [ShardFormer] fix qwen2 sp (#5903)		2024-07-15 13:58:06 +08:00
..
chatglm2_6b	[pre-commit.ci] pre-commit autoupdate (#5572)	2024-07-01 17:16:41 +08:00
__init__.py	[shardformer] added development protocol for standardization (#4149)	2023-07-04 16:05:01 +08:00
bert.py	[shardformer]delete xformers (#5859)	2024-06-28 11:20:04 +08:00
blip2.py	[shardformer] support bias_gelu_jit_fused for models (#5647)	2024-04-29 15:33:51 +08:00
bloom.py	[Feature] Enable PP + SP for llama (#5868)	2024-07-09 18:05:20 +08:00
chatglm2.py	[ShardFormer] Add Ulysses Sequence Parallelism support for Command-R, Qwen2 and ChatGLM (#5897)	2024-07-10 11:34:25 +08:00
command.py	[ShardFormer] Add Ulysses Sequence Parallelism support for Command-R, Qwen2 and ChatGLM (#5897)	2024-07-10 11:34:25 +08:00
deepseek.py	[shardformer] DeepseekMoE support (#5871)	2024-07-05 16:13:58 +08:00
falcon.py	[shardformer] fix modeling of bloom and falcon (#5796)	2024-06-11 17:43:50 +08:00
gpt2.py	[Feature] Enable PP + SP for llama (#5868)	2024-07-09 18:05:20 +08:00
gptj.py	[shardformer] upgrade transformers to 4.39.3 (#5815)	2024-06-14 10:59:33 +08:00
jit.py	[misc] update pre-commit and run all files (#4752)	2023-09-19 14:20:26 +08:00
llama.py	[Feature] Enable PP + SP for llama (#5868)	2024-07-09 18:05:20 +08:00
mistral.py	[Feature] Enable PP + SP for llama (#5868)	2024-07-09 18:05:20 +08:00
mixtral.py	[MoE/ZeRO] Moe refactor with zero refactor (#5821)	2024-06-28 14:00:08 +08:00
opt.py	[Feature] Enable PP + SP for llama (#5868)	2024-07-09 18:05:20 +08:00
qwen2.py	[ShardFormer] fix qwen2 sp (#5903)	2024-07-15 13:58:06 +08:00
sam.py	[shardformer]delete xformers (#5859)	2024-06-28 11:20:04 +08:00
t5.py	[shardformer] Support the T5ForTokenClassification model (#5816)	2024-06-27 16:40:38 +08:00
vit.py	[shardformer] support bias_gelu_jit_fused for models (#5647)	2024-04-29 15:33:51 +08:00
whisper.py	[shardformer] upgrade transformers to 4.39.3 (#5815)	2024-06-14 10:59:33 +08:00