mirror of https://github.com/InternLM/InternLM
upd
parent
23bfc275a9
commit
a415c5204a
|
@ -436,7 +436,7 @@ print(response)
|
||||||
|
|
||||||
#### SGLang inference
|
#### SGLang inference
|
||||||
|
|
||||||
##### Installation
|
Installation
|
||||||
```bash
|
```bash
|
||||||
pip3 install "sglang[srt]>=0.4.1.post6" --find-links https://flashinfer.ai/whl/cu124/torch2.4/flashinfer/
|
pip3 install "sglang[srt]>=0.4.1.post6" --find-links https://flashinfer.ai/whl/cu124/torch2.4/flashinfer/
|
||||||
```
|
```
|
||||||
|
|
Loading…
Reference in New Issue