ColossalAI/colossalai/shardformer/policies
Bin Jia 351351a36e
[shardformer/sequence parallel] not support opt of seq-parallel, add warning and fix a bug in gpt2 pp (#4488)
2023-08-22 17:35:35 +08:00
..
__init__.py [shardformer] init shardformer code structure (#3731) 2023-07-04 16:05:01 +08:00
auto_policy.py rename chatglm to chatglm2 (#4484) 2023-08-22 14:13:31 +08:00
base_policy.py [shardformer/sequence parallel] Cherry pick commit to new branch (#4450) 2023-08-16 15:41:20 +08:00
bert.py [shardformer] bert support sequence parallel. (#4455) 2023-08-18 18:04:55 +08:00
blip2.py [shardformer] Pipeline/whisper (#4456) 2023-08-18 21:29:25 +08:00
bloom.py [shardformer] bloom support sequence parallel (#4465) 2023-08-18 15:34:18 +08:00
chatglm2.py rename chatglm to chatglm2 (#4484) 2023-08-22 14:13:31 +08:00
gpt2.py [shardformer/sequence parallel] support gpt2 seq parallel with pp/dp/tp (#4460) 2023-08-18 11:21:53 +08:00
llama.py [Shardformer] Merge flash attention branch to pipeline branch (#4362) 2023-08-15 23:25:14 +08:00
opt.py [shardformer/sequence parallel] not support opt of seq-parallel, add warning and fix a bug in gpt2 pp (#4488) 2023-08-22 17:35:35 +08:00
sam.py [Shardformer] Merge flash attention branch to pipeline branch (#4362) 2023-08-15 23:25:14 +08:00
t5.py [shardformer] Pipeline/whisper (#4456) 2023-08-18 21:29:25 +08:00
vit.py [format] applied code formatting on changed files in pull request 4441 (#4445) 2023-08-16 10:47:23 +08:00
whisper.py [shardformer] Pipeline/whisper (#4456) 2023-08-18 21:29:25 +08:00