flybird11111 0688d92e2d [shardformer]Fix lm parallel. (#5480) ... * fix * padding vocab_size when using pipeline parallellism padding vocab_size when using pipeline parallellism fix fix * fix * fix fix fix * fix gather output * fix * fix * fix fix resize embedding fix resize embedding * fix resize embedding fix * revert * revert * revert * fix lm forward distribution * fix * test ci * fix		2024-03-25 17:21:51 +08:00
..
__init__.py	…
auto_policy.py	[shardformer]: support gpt-j, falcon, Mistral and add interleaved pipeline for bert (#5088)	2023-11-28 16:54:42 +08:00
base_policy.py	[shardformer] fix gathering output when using tensor parallelism (#5431)	2024-03-18 15:55:11 +08:00
bert.py	[pipeline]: fix p2p comm, add metadata cache and support llama interleaved pp (#5134)	2023-12-22 10:44:00 +08:00
blip2.py	[hotfix] Add layer norm gradients all-reduce for sequence parallel (#4926)	2023-11-03 13:32:43 +08:00
bloom.py	[shardformer]: support gpt-j, falcon, Mistral and add interleaved pipeline for bert (#5088)	2023-11-28 16:54:42 +08:00
chatglm2.py	[Inference] Fix bug in ChatGLM2 Tensor Parallelism (#5014)	2023-11-07 15:01:50 +08:00
falcon.py	fix typo change dosen't to doesn't (#5308)	2024-01-30 09:57:38 +08:00
gpt2.py	[shardformer]Fix lm parallel. (#5480)	2024-03-25 17:21:51 +08:00
gptj.py	[shardformer]: support gpt-j, falcon, Mistral and add interleaved pipeline for bert (#5088)	2023-11-28 16:54:42 +08:00
llama.py	[shardformer]Fix lm parallel. (#5480)	2024-03-25 17:21:51 +08:00
mistral.py	fix typo change dosen't to doesn't (#5308)	2024-01-30 09:57:38 +08:00
opt.py	fix typo change dosen't to doesn't (#5308)	2024-01-30 09:57:38 +08:00
sam.py	[hotfix] Add layer norm gradients all-reduce for sequence parallel (#4926)	2023-11-03 13:32:43 +08:00
t5.py	fix typo change dosen't to doesn't (#5308)	2024-01-30 09:57:38 +08:00
vit.py	fix typo change dosen't to doesn't (#5308)	2024-01-30 09:57:38 +08:00
whisper.py	fix typo change dosen't to doesn't (#5308)	2024-01-30 09:57:38 +08:00