You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Bin Jia 08a9f76b2f [Pipeline Inference] Sync pipeline inference branch to main (#4820) ... * [pipeline inference] pipeline inference (#4492) * add pp stage manager as circle stage * fix a bug when create process group * add ppinfer basic framework * add micro batch manager and support kvcache-pp gpt2 fwd * add generate schedule * use mb size to control mb number * support generate with kv cache * add output, remove unused code * add test * reuse shardformer to build model * refactor some code and use the same attribute name of hf * fix review and add test for generation * remove unused file * fix CI * add cache clear * fix code error * fix typo * [Pipeline inference] Modify to tieweight (#4599) * add pp stage manager as circle stage * fix a bug when create process group * add ppinfer basic framework * add micro batch manager and support kvcache-pp gpt2 fwd * add generate schedule * use mb size to control mb number * support generate with kv cache * add output, remove unused code * add test * reuse shardformer to build model * refactor some code and use the same attribute name of hf * fix review and add test for generation * remove unused file * modify the way of saving newtokens * modify to tieweight * modify test * remove unused file * solve review * add docstring * [Pipeline inference] support llama pipeline inference (#4647) * support llama pipeline inference * remove tie weight operation * [pipeline inference] Fix the blocking of communication when ppsize is 2 (#4708) * add benchmark verbose * fix export tokens * fix benchmark verbose * add P2POp style to do p2p communication * modify schedule as p2p type when ppsize is 2 * remove unused code and add docstring * [Pipeline inference] Refactor code, add docsting, fix bug (#4790) * add benchmark script * update argparse * fix fp16 load * refactor code style * add docstring * polish code * fix test bug * [Pipeline inference] Add pipeline inference docs (#4817) * add readme doc * add a ico * Add performance * update table of contents * refactor code (#4873)		1 year ago
..
test_gemini_checkpoint_io.py	[lazy] support from_pretrained (#4801)	1 year ago
test_gemini_torch_compability.py	…
test_general_checkpoint_io.py	…
test_hybrid_parallel_plugin_checkpoint_io.py	[checkpointio] hotfix torch 2.0 compatibility (#4824)	1 year ago
test_low_level_zero_checkpoint_io.py	[Pipeline Inference] Sync pipeline inference branch to main (#4820)	1 year ago
test_plugins_huggingface_compatibility.py	[shardformer] fix master param sync for hybrid plugin/rewrite unwrapping logic (#4758)	1 year ago
test_torch_ddp_checkpoint_io.py	…
test_torch_fsdp_checkpoint_io.py	…
utils.py	…