Making large AI models cheaper, faster and more accessible
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
 
 
 
 
 
Steve Luo 7806842f2d
add paged-attetionv2: support seq length split across thread block (#5707)
6 months ago
..
cpu_adam [Inference/Refactor] Refactor compilation mechanism and unified multi hw (#5613) 7 months ago
flash_attention [Inference/Refactor] Refactor compilation mechanism and unified multi hw (#5613) 7 months ago
inference add paged-attetionv2: support seq length split across thread block (#5707) 6 months ago
layernorm [Inference/Refactor] Refactor compilation mechanism and unified multi hw (#5613) 7 months ago
moe [Inference/Refactor] Refactor compilation mechanism and unified multi hw (#5613) 7 months ago
optimizer [Inference/Refactor] Refactor compilation mechanism and unified multi hw (#5613) 7 months ago
softmax [Inference/Refactor] Refactor compilation mechanism and unified multi hw (#5613) 7 months ago
__init__.py [Inference/Refactor] Refactor compilation mechanism and unified multi hw (#5613) 7 months ago