github
/
InternLM
mirror of https://github.com/InternLM/InternLM
1
0
Fork 0
Code Issues Projects Releases Wiki Activity

add xcomposer 4bit and internlm2-chat-20b test case

pull/717/head
zhulinJulia24 2024-03-01 09:10:06 +08:00 committed by GitHub
parent 092b8799e4
commit 92b15b180d
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
tests/test_hf_model.py
View File

@ -177,7 +177,7 @@ class TestMMModel:
model_name, trust_remote_code=True, device='cuda:0').eval() model_name, trust_remote_code=True, device='cuda:0').eval()
else: else:
model = AutoModelForCausalLM.from_pretrained( model = AutoModelForCausalLM.from_pretrained(
model_name, torch_dtype=torch.float16, model_name, torch_dtype=torch.float32,
trust_remote_code=True).cuda() trust_remote_code=True).cuda()
tokenizer = AutoTokenizer.from_pretrained(model_name, tokenizer = AutoTokenizer.from_pretrained(model_name,