Commit Graph

1 Commits (7d7ea2ef41486c3c6f8c3595d482c6e15b403bff)

Author SHA1 Message Date
Cuiqing Li 7d7ea2ef41
[Kernels] add necessary kernels (llama & bloom) for attention forward and kv-cache manager (#4485)
* added _vllm_rms_norm

* change place

* added tests

* added tests

* modify

* adding kernels

* added tests:

* adding kernels

* modify

* added

* updating kernels

* adding tests

* added tests

* kernel change

* submit

* modify

* added

* edit comments

* change name

* change commnets and fix import

* add

* added
2023-08-24 16:30:02 +08:00