ColossalAI/extensions/csrc
傅剑寒 9df016fc45
[Inference] Fix quant bits order (#5681)
2024-04-30 19:38:00 +08:00
..
common [Inference/Feat] Add kvcache quant support for fused_rotary_embedding_cache_copy (#5680) 2024-04-30 18:33:53 +08:00
funcs [Inference] Fix quant bits order (#5681) 2024-04-30 19:38:00 +08:00
kernel [Inference/Feat] Add kvcache quant support for fused_rotary_embedding_cache_copy (#5680) 2024-04-30 18:33:53 +08:00
__init__.py [Inference/Refactor] Delete Duplicated code and refactor vec_copy utils and reduce utils (#5593) 2024-04-15 10:57:51 +08:00