ColossalAI/colossalai/inference/modeling
Jianghai bfd9b1b494 [Inference] Pytorch Attention func, pad&nopad input support (#5219)
* add attn

* add attention test

* fix attn forward

* fix decoding
2024-01-11 13:44:06 +00:00
..
layers [Inference] Pytorch Attention func, pad&nopad input support (#5219) 2024-01-11 13:44:06 +00:00
models fix beam_width 2024-01-11 13:39:56 +00:00
policy Fixed a bug in the inference frame 2024-01-11 13:39:56 +00:00