github
/
ChatGLM-6B
mirror of https://github.com/THUDM/ChatGLM-6B
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
Browse Source

Merge pull request #223 from mojianhao/patch-1 

Update api.py
pull/235/head
Zhengxiao Du 2 years ago committed by GitHub
parent
28665ade15 1047e446e5
commit
697ee00263
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 2 additions and 2 deletions
Whitespace
Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL
Unified View
Diff Options
Show Stats Download Patch File Download Diff File
  1. 4
      api.py

4
api.py
Unescape View File

@ -28,8 +28,8 @@ async def create_item(request: Request):
if __name__ == '__main__': if __name__ == '__main__':
uvicorn.run('API:app', host='0.0.0.0', port=8000, workers=1) uvicorn.run('api:app', host='0.0.0.0', port=8000, workers=1)
tokenizer = AutoTokenizer.from_pretrained("THUDM/chatglm-6b", trust_remote_code=True) tokenizer = AutoTokenizer.from_pretrained("THUDM/chatglm-6b", trust_remote_code=True)
model = AutoModel.from_pretrained("THUDM/chatglm_6b", trust_remote_code=True).half().cuda() model = AutoModel.from_pretrained("THUDM/chatglm-6b", trust_remote_code=True).half().cuda()
model.eval() model.eval()

Write Preview
Loading…
Cancel
Save