github
/
InternLM
mirror of https://github.com/InternLM/InternLM
1
0
Fork 0
Code Issues Projects Releases Wiki Activity

upd

pull/821/head
zhyncs 2025-01-15 17:15:03 +08:00
parent 975487effd
commit 23bfc275a9
1 changed files with 0 additions and 14 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

14
README.md
View File

@ -267,20 +267,6 @@ pip3 install "sglang[srt]>=0.4.1.post6" --find-links https://flashinfer.ai/whl/c
python3 -m sglang.launch_server --model internlm/internlm3-8b-instruct --trust-remote-code --chat-template internlm2-chat python3 -m sglang.launch_server --model internlm/internlm3-8b-instruct --trust-remote-code --chat-template internlm2-chat
``` ```
##### cURL client
```bash
curl http://127.0.0.1:30000/v1/chat/completions \
-H "Content-Type: application/json" \
-H "Authorization: Bearer EMPTY" \
-d '{
"model": "internlm/internlm3-8b-instruct",
"messages": [{"role": "user", "content": "Introduce Shanghai"}],
"stream": false
}' \
--no-buffer
```
##### OpenAI client ##### OpenAI client
```python3 ```python3