mirror of https://github.com/THUDM/ChatGLM-6B
添加Windows用户部署文档
本次添加了一个Windows用户部署文档，基于WSL，可以让门槛更低，让技术触达更多的人，让更多人白嫖……啊，不是 是让更多人感受科技的力量和魅力！pull/243/head
ZhangErling
GitHub
parent
963d5645ef
commit
e34e6ecea1
|
|
@ -0,0 +1,233 @@
|
||||||
|
## Windows部署
|
||||||
|
|
||||||
|
### win10
|
||||||
|
|
||||||
|
#### 通过wsl部署
|
||||||
|
|
||||||
|
**特别注意**
|
||||||
|
|
||||||
|
对于已在使用的wsl用户，请注意自己数据安全，特别是做好 [备份](https://learn.microsoft.com/zh-cn/windows/wsl/basic-commands#import-and-export-a-distribution)
|
||||||
|
对于已在使用的wsl用户，请注意自己数据安全，特别是做好 [备份](https://learn.microsoft.com/zh-cn/windows/wsl/basic-commands#import-and-export-a-distribution)
|
||||||
|
对于已在使用的wsl用户，请注意自己数据安全，特别是做好 [备份](https://learn.microsoft.com/zh-cn/windows/wsl/basic-commands#import-and-export-a-distribution)
|
||||||
|
|
||||||
|
**常见问题：**
|
||||||
|
|
||||||
|
torch.cuda.OutOfMemoryError: CUDA out of memory.
|
||||||
|
> 在Windows的系统环境变量中增加
|
||||||
|
> 变量名：`PYTORCH_CUDA_ALLOC_CONF`
|
||||||
|
> 变量值：`max_split_size_mb:32`
|
||||||
|
> 文档书写时使用3090 24G显存配置，其他规格酌情调整 32 至其他值，如未设置变量默认值128极大概率导致 CUDA OOM
|
||||||
|
|
||||||
|
无法正常启动：比如命令卡死、无响应、不继续执行等等非报错异常
|
||||||
|
> 无敌三步走
|
||||||
|
> 1.Ctrl+C 终止命令执行，重新执行命令
|
||||||
|
> 2.退出实例`exit`,关闭实例`wsl --shutdown`，启动并进入实例 `wsl`
|
||||||
|
> 3.重启电脑，重新进入实例，重新执行命令
|
||||||
|
|
||||||
|
查看虚拟化是否启用
|
||||||
|
> 调取任务管理器 `Ctrl+Shift+Esc` 或 `Win+X -> T` 或 `任务栏-> 右键 -> 任务管理器`
|
||||||
|
> 性能 -> CPU -> 右下角虚拟化**已启用**
|
||||||
|
> 其他方式自行搜索
|
||||||
|
|
||||||
|
1. **前置准备**
|
||||||
|
|
||||||
|
显卡驱动自行更新 https://www.nvidia.cn/Download/index.aspx?lang=cn 记得备份现有驱动
|
||||||
|
wsl开发环境配置 https://learn.microsoft.com/zh-cn/windows/wsl/setup/environment
|
||||||
|
> 需自行研究，失败因素过多无法列举，尤其是启用虚拟化失败导致无法正常启动wsl服务
|
||||||
|
|
||||||
|
wsl导入任意Linux发行版本 https://learn.microsoft.com/zh-cn/windows/wsl/use-custom-distro 可选
|
||||||
|
|
||||||
|
2. **wsl安装指定的Linux发行版 Debian**
|
||||||
|
|
||||||
|
将 wsl 默认版本设置为 2
|
||||||
|
|
||||||
|
```shell
|
||||||
|
wsl --set-default-version 2
|
||||||
|
```
|
||||||
|
|
||||||
|
安装指定的Linux发行版，本文档以Debian为例
|
||||||
|
|
||||||
|
```shell
|
||||||
|
wsl --install Debian
|
||||||
|
```
|
||||||
|
|
||||||
|
安装完成后会提示输入新用户名，**直接Ctrl+C** 取消输入操作
|
||||||
|
|
||||||
|
默认会安装到C盘，C盘可用空间大于25G，可以跳过迁移步骤，但是 **必须设置wsl默认启动实例** 步骤4
|
||||||
|
|
||||||
|
3.**迁移目录**
|
||||||
|
|
||||||
|
导出
|
||||||
|
|
||||||
|
```shell
|
||||||
|
wsl --export Debian E:\debian.tar
|
||||||
|
```
|
||||||
|
|
||||||
|
Debian 实例名
|
||||||
|
E:\debian.tar 文件保存的地址
|
||||||
|
|
||||||
|
导入
|
||||||
|
|
||||||
|
```shell
|
||||||
|
wsl --import newDebian D:\tools\wsl_data E:\debian.tar
|
||||||
|
```
|
||||||
|
|
||||||
|
newDebian 新的实例名
|
||||||
|
D:\tools\wsl_data 新的实例保存地址
|
||||||
|
E:\debian.tar 导入的文件地址
|
||||||
|
|
||||||
|
查看导入结果，列出所有实例
|
||||||
|
|
||||||
|
```shell
|
||||||
|
wsl --list --verbose
|
||||||
|
```
|
||||||
|
|
||||||
|
| **NAME** | **STATE** | **VERSION** |
|
||||||
|
|----------|-----------|-------------|
|
||||||
|
| *Debian | Stopped | 2 |
|
||||||
|
| newdebian| Stopped | 2 |
|
||||||
|
|
||||||
|
> *代表当前默认启动实例
|
||||||
|
|
||||||
|
4. 设置默认环境
|
||||||
|
|
||||||
|
修改wsl默认启动实例，**非迁移用户需将 `newDebian` 替换为 `Debian`**
|
||||||
|
|
||||||
|
```shell
|
||||||
|
wsl --set-default newDebian
|
||||||
|
```
|
||||||
|
|
||||||
|
列出所有实例
|
||||||
|
|
||||||
|
```shell
|
||||||
|
wsl --list --verbose
|
||||||
|
```
|
||||||
|
|
||||||
|
| **NAME** | **STATE** | **VERSION** |
|
||||||
|
|------------|-----------|-------------|
|
||||||
|
| Debian | Stopped | 2 |
|
||||||
|
| *newDebian | Stopped | 2 |
|
||||||
|
|
||||||
|
> *代表当前默认启动实例
|
||||||
|
|
||||||
|
设置默认Debian默认登录用户为root
|
||||||
|
|
||||||
|
```shell
|
||||||
|
Debian config --default-user root
|
||||||
|
```
|
||||||
|
|
||||||
|
启动Debian
|
||||||
|
|
||||||
|
```shell
|
||||||
|
wsl
|
||||||
|
```
|
||||||
|
|
||||||
|
> 进入 root@DESKTOP-2BUTCG6:/mnt/c/Users/Administrator#
|
||||||
|
|
||||||
|
5. 配置环境
|
||||||
|
|
||||||
|
更新apt源
|
||||||
|
|
||||||
|
```shell
|
||||||
|
vi /etc/apt/sources.list
|
||||||
|
```
|
||||||
|
|
||||||
|
替换全部
|
||||||
|
> deb http://mirrors.aliyun.com/debian/ buster main non-free contrib
|
||||||
|
deb http://mirrors.aliyun.com/debian/ buster-updates main non-free contrib
|
||||||
|
deb http://mirrors.aliyun.com/debian/ buster-backports main non-free contrib
|
||||||
|
deb http://mirrors.aliyun.com/debian-security buster/updates main
|
||||||
|
deb-src http://mirrors.aliyun.com/debian/ buster main non-free contrib
|
||||||
|
deb-src http://mirrors.aliyun.com/debian/ buster-updates main non-free contrib
|
||||||
|
deb-src http://mirrors.aliyun.com/debian/ buster-backports main non-free contrib
|
||||||
|
deb-src http://mirrors.aliyun.com/debian-security buster/updates main
|
||||||
|
>
|
||||||
|
>deb http://mirrors.163.com/debian/ buster main non-free contrib
|
||||||
|
deb http://mirrors.163.com/debian/ buster-updates main non-free contrib
|
||||||
|
deb http://mirrors.163.com/debian/ buster-backports main non-free contrib
|
||||||
|
deb http://mirrors.163.com/debian-security/ buster/updates main non-free contrib
|
||||||
|
deb-src http://mirrors.163.com/debian/ buster main non-free contrib
|
||||||
|
deb-src http://mirrors.163.com/debian/ buster-updates main non-free contrib
|
||||||
|
deb-src http://mirrors.163.com/debian/ buster-backports main non-free contrib
|
||||||
|
deb-src http://mirrors.163.com/debian-security/ buster/updates main non-free contrib
|
||||||
|
|
||||||
|
更新apt
|
||||||
|
|
||||||
|
```shell
|
||||||
|
apt update
|
||||||
|
```
|
||||||
|
|
||||||
|
安装apt包管理工具
|
||||||
|
|
||||||
|
```shell
|
||||||
|
apt install aptitude
|
||||||
|
# y
|
||||||
|
```
|
||||||
|
|
||||||
|
> y 键盘输入，有多个询问则需要按照顺序输入
|
||||||
|
|
||||||
|
安装 python3
|
||||||
|
|
||||||
|
```shell
|
||||||
|
aptitude install python3
|
||||||
|
# y y
|
||||||
|
```
|
||||||
|
|
||||||
|
安装 python3-pip
|
||||||
|
|
||||||
|
```shell
|
||||||
|
aptitude install python3-pip
|
||||||
|
# y y
|
||||||
|
```
|
||||||
|
|
||||||
|
更新 pip
|
||||||
|
|
||||||
|
```shell
|
||||||
|
pip3 install --upgrade pip -i https://pypi.mirrors.ustc.edu.cn/simple/
|
||||||
|
```
|
||||||
|
|
||||||
|
创建并进入目录
|
||||||
|
|
||||||
|
```shell
|
||||||
|
mkdir /data && cd /data
|
||||||
|
```
|
||||||
|
|
||||||
|
复制文件到当前目录 `/data`
|
||||||
|
|
||||||
|
```shell
|
||||||
|
cp -r /mnt/d/wealth/code/Python/ChatGLM-6B/ .
|
||||||
|
```
|
||||||
|
|
||||||
|
`/mnt/d/wealth/code/Python/ChatGLM-6B/` 项目在Windows系统中所在目录 `/mnt/d` 为`D：`盘
|
||||||
|
> D:\wealth\code\Python\ChatGLM-6B
|
||||||
|
|
||||||
|
`.` 为Debian中的当前目录 `/data`
|
||||||
|
|
||||||
|
进入工作目录
|
||||||
|
|
||||||
|
```shell
|
||||||
|
cd ChatGLM-6B
|
||||||
|
```
|
||||||
|
|
||||||
|
安装项目依赖
|
||||||
|
|
||||||
|
```shell
|
||||||
|
pip3 install -r requirements.txt -i https://pypi.mirrors.ustc.edu.cn/simple/
|
||||||
|
```
|
||||||
|
|
||||||
|
6. 启动项目
|
||||||
|
|
||||||
|
启动web版，其他版本安装依赖后可按需启动
|
||||||
|
|
||||||
|
```shell
|
||||||
|
python3 web_demo.py
|
||||||
|
```
|
||||||
|
|
||||||
|
有一个好消息和一个坏消息
|
||||||
|
好消息是：你已经学会启动ChatGLM-6B了！什么时候做大做强干掉ChatGPT？
|
||||||
|
坏消息是：漫长的下载开始了...(已经自行下载资源的按照要求放入即可)
|
||||||
|
|
||||||
|
7. 代理
|
||||||
|
wsl部署涉及到**非本机访问**请配置代理
|
||||||
|
局域网代理建议用 [nginx](http://nginx.org/)
|
||||||
|
内网穿透建议用 [frp](https://gofrp.org/)
|
||||||
Loading…
Reference in New Issue