Xu Kai fb103cfd6e [inference] update examples and engine (#5073) ... * update examples and engine * fix choices * update example		2023-11-20 19:44:52 +08:00
..
_utils.py	[Inference]ADD Bench Chatglm2 script (#4963)	2023-10-24 13:11:15 +08:00
benchmark.py	[inference] Refactor inference architecture (#5057)	2023-11-19 21:05:05 +08:00
build_smoothquant_weight.py	[inference] update examples and engine (#5073)	2023-11-20 19:44:52 +08:00
run_benchmark.sh	[inference] Refactor inference architecture (#5057)	2023-11-19 21:05:05 +08:00
run_llama_inference.py	[inference] update examples and engine (#5073)	2023-11-20 19:44:52 +08:00