You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Steve Luo 5cd75ce4c7 [Inference/Kernel] refactor kvcache manager and rotary_embedding and kvcache_memcpy oper… (#5663) ... * refactor kvcache manager and rotary_embedding and kvcache_memcpy operator * refactor decode_kv_cache_memcpy * enable alibi in pagedattention		7 months ago
..
__init__.py	[Inference/Refactor] Refactor compilation mechanism and unified multi hw (#5613)	7 months ago
inference.cpp	[Inference/Kernel] refactor kvcache manager and rotary_embedding and kvcache_memcpy oper… (#5663)	7 months ago
inference_ops_cuda.py	[Inference/Refactor] Refactor compilation mechanism and unified multi hw (#5613)	7 months ago