Commit Graph

2 Commits (2226c6836c3aef6bb6cc6a4aec7c9a874799a2b1)

Author SHA1 Message Date
Cuiqing Li 64110b12c0
combine codes (#4509) 2023-08-24 16:43:39 +08:00
Cuiqing Li 7d7ea2ef41
[Kernels] add necessary kernels (llama & bloom) for attention forward and kv-cache manager (#4485)
* added _vllm_rms_norm

* change place

* added tests

* added tests

* modify

* adding kernels

* added tests:

* adding kernels

* modify

* added

* updating kernels

* adding tests

* added tests

* kernel change

* submit

* modify

* added

* edit comments

* change name

* change commnets and fix import

* add

* added
2023-08-24 16:30:02 +08:00