Commit Graph

1 Commits (feat/speculative-decoding)

Author SHA1 Message Date
Xu Kai 611a5a80ca
[inference] Add smmoothquant for llama (#4904)
1 year ago