Li Xingjian 8554585a5f [Inference] Fix flash-attn import and add model test (#5794) ... * Fix torch int32 dtype Signed-off-by: char-1ee <xingjianli59@gmail.com> * Fix flash-attn import Signed-off-by: char-1ee <xingjianli59@gmail.com> * Add generalized model test Signed-off-by: char-1ee <xingjianli59@gmail.com> * Remove exposed path to model Signed-off-by: char-1ee <xingjianli59@gmail.com> * Add default value for use_flash_attn Signed-off-by: char-1ee <xingjianli59@gmail.com> * Rename model test Signed-off-by: char-1ee <xingjianli59@gmail.com> --------- Signed-off-by: char-1ee <xingjianli59@gmail.com>		2024-06-12 14:13:50 +08:00
..
test_attention.py	[Fix] Fix Inference Example, Tests, and Requirements (#5688)	2024-05-08 11:30:15 +08:00
test_baichuan.py	Pass inference model shard configs for module init	2024-06-07 08:33:52 +00:00
test_custom_model.py	[Inference] Fix flash-attn import and add model test (#5794)	2024-06-12 14:13:50 +08:00