Wang Binluo 537f6a3855 [Shardformer]fix the num_heads assert for llama model and qwen model (#5704) ... * fix the num_heads assert * fix the transformers import * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * fix the import --------- Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>		2024-05-10 15:33:39 +08:00
..
chatglm2_6b	[hotfix] fix typo change enabel to enable under colossalai/shardformer/ (#5317)	2024-03-05 21:48:46 +08:00
__init__.py	[shardformer] added development protocol for standardization (#4149)	2023-07-04 16:05:01 +08:00
bert.py	[shardformer] support bias_gelu_jit_fused for models (#5647)	2024-04-29 15:33:51 +08:00
blip2.py	[shardformer] support bias_gelu_jit_fused for models (#5647)	2024-04-29 15:33:51 +08:00
bloom.py	[shardformer] update transformers (#5583)	2024-04-24 22:51:50 +08:00
chatglm2.py	[shardformer] fix chatglm implementation (#5644)	2024-04-25 14:41:17 +08:00
falcon.py	[shardformer] update transformers (#5583)	2024-04-24 22:51:50 +08:00
gpt2.py	[shardformer] support bias_gelu_jit_fused for models (#5647)	2024-04-29 15:33:51 +08:00
gptj.py	[shardformer] update transformers (#5583)	2024-04-24 22:51:50 +08:00
jit.py	[misc] update pre-commit and run all files (#4752)	2023-09-19 14:20:26 +08:00
llama.py	[shardformer] refactor pipeline grad ckpt config (#5646)	2024-04-25 15:19:30 +08:00
mistral.py	fix the mistral model	2024-05-07 09:17:56 +00:00
opt.py	remove comment code	2024-05-07 07:08:56 +00:00
qwen2.py	[Shardformer]fix the num_heads assert for llama model and qwen model (#5704)	2024-05-10 15:33:39 +08:00
sam.py	[misc] update pre-commit and run all files (#4752)	2023-09-19 14:20:26 +08:00
t5.py	[shardformer] update transformers (#5583)	2024-04-24 22:51:50 +08:00
vit.py	[shardformer] support bias_gelu_jit_fused for models (#5647)	2024-04-29 15:33:51 +08:00
whisper.py	[shardformer] update transformers (#5583)	2024-04-24 22:51:50 +08:00