flybird11111 3f2be80530 fix (#5765)		2024-06-03 11:25:18 +08:00
..
__init__.py	[shardformer] init shardformer code structure (#3731)	2023-07-04 16:05:01 +08:00
auto_policy.py	[Shardformer] Support the Qwen2 model (#5699)	2024-05-09 20:04:25 +08:00
base_policy.py	[shardformer] refactor pipeline grad ckpt config (#5646)	2024-04-25 15:19:30 +08:00
bert.py	[Shardformer] add assert for num of attention heads divisible by tp_size (#5670)	2024-04-29 18:47:47 +08:00
blip2.py	[Shardformer] add assert for num of attention heads divisible by tp_size (#5670)	2024-04-29 18:47:47 +08:00
bloom.py	[Shardformer] Add parallel output for shardformer models(bloom, falcon) (#5702)	2024-05-21 11:07:13 +08:00
chatglm2.py	[shardformer] fix chatglm implementation (#5644)	2024-04-25 14:41:17 +08:00
falcon.py	[Shardformer] Add parallel output for shardformer models(bloom, falcon) (#5702)	2024-05-21 11:07:13 +08:00
gpt2.py	[Shardformer] add assert for num of attention heads divisible by tp_size (#5670)	2024-04-29 18:47:47 +08:00
gptj.py	[Shardformer] add assert for num of attention heads divisible by tp_size (#5670)	2024-04-29 18:47:47 +08:00
llama.py	fix (#5765)	2024-06-03 11:25:18 +08:00
mistral.py	[pre-commit.ci] auto fixes from pre-commit.com hooks	2024-05-07 07:03:47 +00:00
opt.py	[pre-commit.ci] auto fixes from pre-commit.com hooks	2024-05-07 07:07:09 +00:00
qwen2.py	[Shardformer]fix the num_heads assert for llama model and qwen model (#5704)	2024-05-10 15:33:39 +08:00
sam.py	[Shardformer] add assert for num of attention heads divisible by tp_size (#5670)	2024-04-29 18:47:47 +08:00
t5.py	[Shardformer] add assert for num of attention heads divisible by tp_size (#5670)	2024-04-29 18:47:47 +08:00
vit.py	[Shardformer] add assert for num of attention heads divisible by tp_size (#5670)	2024-04-29 18:47:47 +08:00
whisper.py	[Shardformer] add assert for num of attention heads divisible by tp_size (#5670)	2024-04-29 18:47:47 +08:00