Commit Graph

1 Commits (bfd9b1b494b4414835b22cbba52005921127e4f6)

Author SHA1 Message Date
Jianghai bfd9b1b494 [Inference] Pytorch Attention func, pad&nopad input support (#5219)
* add attn

* add attention test

* fix attn forward

* fix decoding
2024-01-11 13:44:06 +00:00