Cuiqing Li (李崔卿) bce919708f [Kernels]added flash-decoidng of triton (#5063) ... * added flash-decoidng of triton based on lightllm kernel * add req * clean * clean * delete build.sh --------- Co-authored-by: cuiqing.li <lixx336@gmail.com>		2023-11-20 13:58:29 +08:00
..
_utils.py	[Inference]ADD Bench Chatglm2 script (#4963)	2023-10-24 13:11:15 +08:00
benchmark.py	[inference] Refactor inference architecture (#5057)	2023-11-19 21:05:05 +08:00
hybrid_gptq_llama.py	[inference] Refactor inference architecture (#5057)	2023-11-19 21:05:05 +08:00
hybrid_llama.py	[Kernels]added flash-decoidng of triton (#5063)	2023-11-20 13:58:29 +08:00
hybrid_smoothquant_llama.py	[inference] Refactor inference architecture (#5057)	2023-11-19 21:05:05 +08:00
run_benchmark.sh	[inference] Refactor inference architecture (#5057)	2023-11-19 21:05:05 +08:00
smoothquant_llama.py	[inference] Add smmoothquant for llama (#4904)	2023-10-16 11:28:44 +08:00