github
/
InternLM
mirror of https://github.com/InternLM/InternLM
1
0
Fork 0
Code Issues Projects Releases Wiki Activity

fix according to reviewer comments

pull/745/head
lvhan028 2024-06-25 19:52:50 +08:00
parent f8dbc35e0f
commit 2968b8ab24
2 changed files with 4 additions and 4 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

6
ecosystem/README.md
View File

@ -34,7 +34,7 @@ SWIFT supports training, inference, evaluation and deployment of LLMs and MLLMs
LMDeploy is an efficient toolkit for compressing, deploying, and serving LLMs and VLMs.
With only 4 lines of codes, you can perform `internlm2-chat-7b` inference after `pip install lmdeploy`:
With only 4 lines of code, you can perform `internlm2-chat-7b` inference after `pip install lmdeploy`:
```python
from lmdeploy import pipeline
@ -141,7 +141,7 @@ llamafile lets you turn large language model (LLM) weights into executables. It
The best practice of deploying InternLM2 using llamafile is shown as below:
- Convert the internlm2 model into GGUF model by `llama.cpp`. Suppose we get `internlm2-chat-7b.gguf` in this step
- create the llamafile
- Create the llamafile
```shell
wget https://github.com/Mozilla-Ocho/llamafile/releases/download/0.8.6/llamafile-0.8.6.zip
@ -157,7 +157,7 @@ internlm2-chat-7b.gguf
999
..." > .args
zipalign -j0 \
llamafile-0.8.6/bin/zipalign -j0 \
internlm2.llamafile \
internlm2-chat-7b.gguf \
.args

2
ecosystem/README_zh-CN.md
View File

@ -161,7 +161,7 @@ internlm2-chat-7b.gguf
999
..." > .args
zipalign -j0 \
llamafile-0.8.6/bin/zipalign -j0 \
internlm2.llamafile \
internlm2-chat-7b.gguf \
.args