github
/
ColossalAI
mirror of https://github.com/hpcaitech/ColossalAI
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
Branches Tags
${ item.name }
Create tag ${ searchTerm }
Create branch ${ searchTerm }
from 'feat/online-serving'
${ noResults }
ColossalAI/extensions/csrc
History
傅剑寒 1ace1065e6
[Inference/Feat] Add quant kvcache support for decode_kv_cache_memcpy (#5686) 		7 months ago
..
common [Inference] Remove unnecessary float4_ and rename float8_ to float8 (#5679) 7 months ago
funcs [Inference] Remove unnecessary float4_ and rename float8_ to float8 (#5679) 7 months ago
kernel [Inference/Feat] Add quant kvcache support for decode_kv_cache_memcpy (#5686) 7 months ago
__init__.py [Inference/Refactor] Delete Duplicated code and refactor vec_copy utils and reduce utils (#5593) 7 months ago