Hongxin Liu 1cd7efc520 [inference] refactor examples and fix schedule (#5077) ... * [setup] refactor infer setup * [hotfix] fix infenrece behavior on 1 1 gpu * [exmaple] refactor inference examples		2023-11-21 10:46:03 +08:00
..
schedule	[inference] refactor examples and fix schedule (#5077)	2023-11-21 10:46:03 +08:00
__init__.py	[misc] update pre-commit and run all files (#4752)	2023-09-19 14:20:26 +08:00
p2p.py	[pipeline,shardformer] Fix p2p efficiency in pipeline, allow skipping loading weight not in weight_map when `strict=False`, fix llama flash attention forward, add flop estimation by megatron in llama benchmark (#5017)	2023-11-16 20:15:59 +08:00
stage_manager.py	[Pipeline Inference] Sync pipeline inference branch to main (#4820)	2023-10-11 11:40:06 +08:00