You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Bin Jia b6696beb04 [Pipeline Inference] Merge pp with tp (#4993) ... * refactor pipeline into new CaiInferEngine * updata llama modeling forward * merge tp with pp * update docstring * optimize test workflow and example * fix typo * add assert and todo		1 year ago
..
kit	[Inference] Dynamic Batching Inference, online and offline (#4953)	1 year ago
test_analyzer	…
test_auto_parallel	…
test_autochunk	…
test_booster	[gemini] support gradient accumulation (#4869)	1 year ago
test_checkpoint_io	[hotfix] fix lr scheduler bug in torch 2.0 (#4864)	1 year ago
test_cluster	…
test_config	…
test_device	…
test_fx	…
test_gptq	…
test_infer	[Pipeline Inference] Merge pp with tp (#4993)	1 year ago
test_infer_ops/triton	[Kernels]Updated Triton kernels into 2.1.0 and adding flash-decoding for llama token attention (#4965)	1 year ago
test_lazy	[lazy] support from_pretrained (#4801)	1 year ago
test_legacy	[test] merge old components to test to model zoo (#4945)	1 year ago
test_moe	[misc] update pre-commit and run all files (#4752)	1 year ago
test_optimizer	[test] merge old components to test to model zoo (#4945)	1 year ago
test_pipeline	…
test_shardformer	[hotfix] fix torch 2.0 compatibility (#4936)	1 year ago
test_smoothquant	[inference] Add smmoothquant for llama (#4904)	1 year ago
test_tensor	…
test_utils	…
test_zero	[test] merge old components to test to model zoo (#4945)	1 year ago
__init__.py	…