github
/
ColossalAI
mirror of https://github.com/hpcaitech/ColossalAI
1
0
Fork 0
Code Issues Projects Releases Wiki Activity

[Inference]Fix example in readme (#6178)

pull/6162/head^2
Guangyao Zhang 2025-01-08 11:51:50 +08:00 committed by GitHub
parent ee81366cac
commit 5b094a836b
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
colossalai/inference/README.md
View File

@ -62,7 +62,7 @@ engine = InferenceEngine(model, tokenizer, inference_config, verbose=True)
# Step 4: try inference
prompts = ['Who is the best player in the history of NBA?']
response = engine.generate(prompts)
response = engine.generate(prompts=prompts)
pprint(response)
```