3 Commits (ef4c14a5e2f30ed31d3befaaed6777cb8be0302c)

Author	SHA1	Message	Date
Jianghai	ef4c14a5e2	[Inference] Fix bug in ChatGLM2 Tensor Parallelism (#5014) ... * fix bug * fix * fix multiquery * fix multiquery --------- Co-authored-by: CjhHa1 <cjh18671720497outlook.com>	2023-11-07 15:01:50 +08:00
Jianghai	013a4bedf0	[inference]fix import bug and delete down useless init (#4830) ... * fix import bug and release useless init * fix * fix * fix	2023-10-04 09:18:45 +08:00
Jianghai	ce7ade3882	[inference] chatglm2 infer demo (#4724) ... * add chatglm2 * add * gather needed kernels * fix some bugs * finish context forward * finish context stage * fix * add * pause * add * fix bugs * finish chatglm * fix bug * change some logic * fix bugs * change some logics * add * add * add * fix * fix tests * fix	2023-09-22 11:12:50 +08:00