9 Commits (10e3c9f923caf4fb68ab61e96c244bd5cca9b9da)

Author	SHA1	Message	Date
yuehuayingxueluo	2a73e828eb	fix bugs related to processing padding mask	2024-01-11 13:46:14 +00:00
yuehuayingxueluo	fa4fbdbffb	adapted to pad_context_forward	2024-01-11 13:44:06 +00:00
yuehuayingxueluo	47e53eaa1c	fix bugs in attention.py and request_handler.py	2024-01-11 13:44:06 +00:00
yuehuayingxueluo	3ad1f3b78b	fix beam_width	2024-01-11 13:39:56 +00:00
yuehuayingxueluo	b2eb9cd186	Fixed a typo	2024-01-11 13:39:56 +00:00
yuehuayingxueluo	02c1bf8b2a	add context_attention_unpadded	2024-01-11 13:39:56 +00:00
yuehuayingxueluo	9489dc64d8	precision alignment	2024-01-11 13:39:56 +00:00
yuehuayingxueluo	62fd08ee44	Fixed a bug in the inference frame	2024-01-11 13:39:56 +00:00
yuehuayingxueluo	86853a37d5	Add padding llama model	2024-01-11 13:39:56 +00:00