From c9845a3aa5c1cd2790ec9528fcc500154a520600 Mon Sep 17 00:00:00 2001 From: =?UTF-8?q?=E7=91=BE=E8=BE=B0?= Date: Thu, 8 Jun 2023 15:28:17 +0800 Subject: [PATCH] =?UTF-8?q?update=20ptuning/README.md=20=E5=8D=95=E5=8D=A1?= =?UTF-8?q?=E5=85=A8=E5=8F=82=E6=95=B0finetune=E5=BB=BA=E8=AE=AE?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit --- ptuning/README.md | 4 ++++ 1 file changed, 4 insertions(+) diff --git a/ptuning/README.md b/ptuning/README.md index f92a328..c2f17c3 100644 --- a/ptuning/README.md +++ b/ptuning/README.md @@ -42,6 +42,10 @@ bash train.sh 如果需要进行全参数的 Finetune,需要安装 [Deepspeed](https://github.com/microsoft/DeepSpeed),然后运行以下指令: +单卡全参数的 Finetune建议: +1)如果需要在3090[24G显存]单卡进行finetune,可下载chatglm-6b-int4,地址:https://huggingface.co/THUDM/chatglm-6b-int4 +2)微调私域数据出现答案阶段问题,可修改max_source_length和max_target_length,调大即可 + ```shell bash ds_train_finetune.sh ```