傅剑寒 1ace1065e6 [Inference/Feat] Add quant kvcache support for decode_kv_cache_memcpy (#5686)		2024-05-06 15:35:13 +08:00
..
common	[Inference] Remove unnecessary float4_ and rename float8_ to float8 (#5679)	2024-05-06 10:55:34 +08:00
funcs	[Inference] Remove unnecessary float4_ and rename float8_ to float8 (#5679)	2024-05-06 10:55:34 +08:00
kernel	[Inference/Feat] Add quant kvcache support for decode_kv_cache_memcpy (#5686)	2024-05-06 15:35:13 +08:00
__init__.py	[Inference/Refactor] Delete Duplicated code and refactor vec_copy utils and reduce utils (#5593)	2024-04-15 10:57:51 +08:00