flybird11111 aaafb38851 [Device]Support npu (#6159) ... * support npu * support pretrain support pretrain fix * support lora fix fix * support chatglm fix fxi fix [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci fix fix [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci fix [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci fix fix fix * Update train.py * Update train.py * fix * fix * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * fix * fix * fix * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci --------- Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>		2024-12-17 15:42:39 +08:00
..
__init__.py	[shardformer] init shardformer code structure (#3731)	2023-07-04 16:05:01 +08:00
auto_policy.py	[FP8] rebase main (#5963)	2024-08-06 16:29:37 +08:00
base_policy.py	[fp8] Merge feature/fp8_comm to main branch of Colossalai (#6016)	2024-08-22 09:21:34 +08:00
bert.py	[Zerobubble] merge main. (#6142)	2024-11-19 19:00:36 +08:00
blip2.py	[shardformer] fix linear 1d row and support uneven splits for fused qkv linear (#6084)	2024-10-10 14:34:45 +08:00
bloom.py	[shardformer] optimize seq parallelism (#6086)	2024-10-11 13:44:40 +08:00
chatglm2.py	[Device]Support npu (#6159)	2024-12-17 15:42:39 +08:00
command.py	[fp8] Merge feature/fp8_comm to main branch of Colossalai (#6016)	2024-08-22 09:21:34 +08:00
deepseek.py	[hotfix] moe hybrid parallelism benchmark & follow-up fix (#6048)	2024-09-10 17:30:53 +08:00
falcon.py	[fp8] support hybrid parallel plugin (#5982)	2024-08-12 18:17:05 +08:00
gpt2.py	[shardformer] optimize seq parallelism (#6086)	2024-10-11 13:44:40 +08:00
gptj.py	[shardformer] optimize seq parallelism (#6086)	2024-10-11 13:44:40 +08:00
llama.py	[Zerobubble] merge main. (#6142)	2024-11-19 19:00:36 +08:00
mistral.py	[Zerobubble] merge main. (#6142)	2024-11-19 19:00:36 +08:00
mixtral.py	[Zerobubble] merge main. (#6142)	2024-11-19 19:00:36 +08:00
opt.py	[fp8] support hybrid parallel plugin (#5982)	2024-08-12 18:17:05 +08:00
qwen2.py	[Feature] Zigzag Ring attention (#5905)	2024-08-16 13:56:38 +08:00
sam.py	[shardformer] fix linear 1d row and support uneven splits for fused qkv linear (#6084)	2024-10-10 14:34:45 +08:00
t5.py	[fp8] support hybrid parallel plugin (#5982)	2024-08-12 18:17:05 +08:00
vit.py	[fp8] support hybrid parallel plugin (#5982)	2024-08-12 18:17:05 +08:00
whisper.py	[fp8] support hybrid parallel plugin (#5982)	2024-08-12 18:17:05 +08:00