flybird11111 29695cf70c [example]add gpt2 benchmark example script. (#5295) ... * benchmark gpt2 * fix fix fix fix * [doc] fix typo in Colossal-LLaMA-2/README.md (#5247) * [workflow] fixed build CI (#5240) * [workflow] fixed build CI * polish * polish * polish * polish * polish * [ci] fixed booster test (#5251) * [ci] fixed booster test * [ci] fixed booster test * [ci] fixed booster test * [ci] fixed ddp test (#5254) * [ci] fixed ddp test * polish * fix typo in applications/ColossalEval/README.md (#5250) * [ci] fix shardformer tests. (#5255) * fix ci fix * revert: revert p2p * feat: add enable_metadata_cache option * revert: enable t5 tests --------- Co-authored-by: Wenhao Chen <cwher@outlook.com> * [doc] fix doc typo (#5256) * [doc] fix annotation display * [doc] fix llama2 doc * [hotfix]: add pp sanity check and fix mbs arg (#5268) * fix: fix misleading mbs arg * feat: add pp sanity check * fix: fix 1f1b sanity check * [workflow] fixed incomplete bash command (#5272) * [workflow] fixed oom tests (#5275) * [workflow] fixed oom tests * polish * polish * polish * [ci] fix test_hybrid_parallel_plugin_checkpoint_io.py (#5276) * fix ci fix * fix test * revert: revert p2p * feat: add enable_metadata_cache option * revert: enable t5 tests * fix --------- Co-authored-by: Wenhao Chen <cwher@outlook.com> * [shardformer] hybridparallelplugin support gradients accumulation. (#5246) * support gradients acc fix fix fix fix fix fix fix fix fix fix fix fix fix * fix fix * fix fix fix * [hotfix] Fix ShardFormer test execution path when using sequence parallelism (#5230) * fix auto loading gpt2 tokenizer (#5279) * [doc] add llama2-13B disyplay (#5285) * Update README.md * fix 13b typo --------- Co-authored-by: binmakeswell <binmakeswell@gmail.com> * fix llama pretrain (#5287) * fix * fix * fix fix * fix fix fix * fix fix * benchmark gpt2 * fix fix fix fix * [workflow] fixed build CI (#5240) * [workflow] fixed build CI * polish * polish * polish * polish * polish * [ci] fixed booster test (#5251) * [ci] fixed booster test * [ci] fixed booster test * [ci] fixed booster test * fix fix * fix fix fix * fix * fix fix fix fix fix * fix * Update shardformer.py --------- Co-authored-by: digger yu <digger-yu@outlook.com> Co-authored-by: Frank Lee <somerlee.9@gmail.com> Co-authored-by: Wenhao Chen <cwher@outlook.com> Co-authored-by: binmakeswell <binmakeswell@gmail.com> Co-authored-by: Zhongkai Zhao <kanezz620@gmail.com> Co-authored-by: Michelle <97082656+MichelleMa8@users.noreply.github.com> Co-authored-by: Desperado-Jia <502205863@qq.com>		2024-03-04 16:18:13 +08:00
..
__init__.py	[shardformer] init shardformer code structure (#3731)	2023-07-04 16:05:01 +08:00
auto_policy.py	[shardformer]: support gpt-j, falcon, Mistral and add interleaved pipeline for bert (#5088)	2023-11-28 16:54:42 +08:00
base_policy.py	[shardformer]: support gpt-j, falcon, Mistral and add interleaved pipeline for bert (#5088)	2023-11-28 16:54:42 +08:00
bert.py	[pipeline]: fix p2p comm, add metadata cache and support llama interleaved pp (#5134)	2023-12-22 10:44:00 +08:00
blip2.py	[hotfix] Add layer norm gradients all-reduce for sequence parallel (#4926)	2023-11-03 13:32:43 +08:00
bloom.py	[shardformer]: support gpt-j, falcon, Mistral and add interleaved pipeline for bert (#5088)	2023-11-28 16:54:42 +08:00
chatglm2.py	[Inference] Fix bug in ChatGLM2 Tensor Parallelism (#5014)	2023-11-07 15:01:50 +08:00
falcon.py	fix typo change dosen't to doesn't (#5308)	2024-01-30 09:57:38 +08:00
gpt2.py	[example]add gpt2 benchmark example script. (#5295)	2024-03-04 16:18:13 +08:00
gptj.py	[shardformer]: support gpt-j, falcon, Mistral and add interleaved pipeline for bert (#5088)	2023-11-28 16:54:42 +08:00
llama.py	fix typo change dosen't to doesn't (#5308)	2024-01-30 09:57:38 +08:00
mistral.py	fix typo change dosen't to doesn't (#5308)	2024-01-30 09:57:38 +08:00
opt.py	fix typo change dosen't to doesn't (#5308)	2024-01-30 09:57:38 +08:00
sam.py	[hotfix] Add layer norm gradients all-reduce for sequence parallel (#4926)	2023-11-03 13:32:43 +08:00
t5.py	fix typo change dosen't to doesn't (#5308)	2024-01-30 09:57:38 +08:00
vit.py	fix typo change dosen't to doesn't (#5308)	2024-01-30 09:57:38 +08:00
whisper.py	fix typo change dosen't to doesn't (#5308)	2024-01-30 09:57:38 +08:00