flybird11111 f1a3a326c4 [fp8]Moe support fp8 communication (#5977) ... * fix * support moe fp8 * fix * fix * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * fix * fix * fix * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * fix * fix * fix fix fi * fix * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * fix --------- Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>		2024-08-09 18:26:02 +08:00
..
__init__.py	[shardformer] init shardformer code structure (#3731)	2023-07-04 16:05:01 +08:00
auto_policy.py	[FP8] rebase main (#5963)	2024-08-06 16:29:37 +08:00
base_policy.py	[shardformer] refactor pipeline grad ckpt config (#5646)	2024-04-25 15:19:30 +08:00
bert.py	[shardformer]delete xformers (#5859)	2024-06-28 11:20:04 +08:00
blip2.py	[Shardformer] add assert for num of attention heads divisible by tp_size (#5670)	2024-04-29 18:47:47 +08:00
bloom.py	[shardformer]delete xformers (#5859)	2024-06-28 11:20:04 +08:00
chatglm2.py	[FP8] rebase main (#5963)	2024-08-06 16:29:37 +08:00
command.py	[FP8] rebase main (#5963)	2024-08-06 16:29:37 +08:00
deepseek.py	[fp8]Moe support fp8 communication (#5977)	2024-08-09 18:26:02 +08:00
falcon.py	[Shardformer] Add parallel output for shardformer models(bloom, falcon) (#5702)	2024-05-21 11:07:13 +08:00
gpt2.py	shardformer fp8	2024-07-16 06:56:51 +00:00
gptj.py	[shardformer] upgrade transformers to 4.39.3 (#5815)	2024-06-14 10:59:33 +08:00
llama.py	[FP8] rebase main (#5963)	2024-08-06 16:29:37 +08:00
mistral.py	[shardformer] upgrade transformers to 4.39.3 (#5815)	2024-06-14 10:59:33 +08:00
mixtral.py	[fp8]Moe support fp8 communication (#5977)	2024-08-09 18:26:02 +08:00
opt.py	[pre-commit.ci] auto fixes from pre-commit.com hooks	2024-05-07 07:07:09 +00:00
qwen2.py	[FP8] rebase main (#5963)	2024-08-06 16:29:37 +08:00
sam.py	[shardformer]delete xformers (#5859)	2024-06-28 11:20:04 +08:00
t5.py	[shardformer] Support the T5ForTokenClassification model (#5816)	2024-06-27 16:40:38 +08:00
vit.py	[Shardformer] add assert for num of attention heads divisible by tp_size (#5670)	2024-04-29 18:47:47 +08:00
whisper.py	[Shardformer] add assert for num of attention heads divisible by tp_size (#5670)	2024-04-29 18:47:47 +08:00