Commit Graph

357 Commits (16fd212c05fc721e18ebf3dd997902049f8b847b)

Author SHA1 Message Date
duzx16 7436f0840f Add todo 2023-03-31 22:55:36 +08:00
duzx16 ff3761fc1a Merge branch 'main' of github.com:THUDM/ChatGLM-6B 2023-03-31 20:15:51 +08:00
duzx16 73f4fe1ffe Add validation file name
Use full prediction
2023-03-31 20:15:35 +08:00
rainatam 893706a82d Update train script 2023-03-31 18:12:04 +08:00
duzx16 08d880141d Fix revision for loading model 2023-03-31 16:32:34 +08:00
duzx16 08f0731e94 Merge branch 'main' of github.com:THUDM/ChatGLM-6B 2023-03-31 15:19:16 +08:00
duzx16 c206e7d9ad Update requirements.txt 2023-03-31 15:18:21 +08:00
Shaw fdc2c7f70d
Update README.md 2023-03-31 14:48:55 +08:00
Shaw 7e84262ddc
Update README.md 2023-03-31 14:13:51 +08:00
Aohan Zeng ba93cafa7d
Update README.md 2023-03-31 12:29:39 +08:00
Aohan Zeng 9853cd2c97
Update README.md 2023-03-31 12:26:09 +08:00
Aohan Zeng 4c923c4ed7
Update p-tuning-v2 2023-03-31 12:21:09 +08:00
Aohan Zeng 99875468dd
Update README.md 2023-03-31 11:46:21 +08:00
duzx16 24e24d5d6c Fix model path 2023-03-31 11:30:36 +08:00
duzx16 5e818065e4 Update memory requirement 2023-03-31 11:29:34 +08:00
duzx16 d2645d8816 Update batch size 2023-03-31 11:28:13 +08:00
duzx16 971a6fbb20 Updaet ADGEN link 2023-03-31 11:27:29 +08:00
duzx16 77da046839 Update model path 2023-03-31 10:49:21 +08:00
duzx16 a100769153 Add P-Tuning v2 2023-03-31 10:46:44 +08:00
duzx16 50a7c3c530 Merge branch 'main' of github.com:THUDM/ChatGLM-6B 2023-03-31 10:45:13 +08:00
duzx16 968a30672a Add P-Tuning v2 2023-03-31 10:43:55 +08:00
Shaw ee7fa65ebd
Update README.md 2023-03-30 11:49:53 +08:00
Shaw 32d625463c
Update README.md 2023-03-30 11:49:07 +08:00
duzx16 323ce7c865 Add instructions for installing Git LFS 2023-03-29 23:24:33 +08:00
duzx16 fc55c075fe Update README 2023-03-28 21:35:52 +08:00
duzx16 7d7d87c4bd Update README 2023-03-28 21:18:59 +08:00
duzx16 343e7bc7b6 Fix model path 2023-03-28 19:52:32 +08:00
Zhengxiao Du 25356d6441
Merge pull request #225 from holk-h/main
Support stream out interruption by using Ctrl+C
2023-03-28 19:50:29 +08:00
duzx16 6fc8141a9c Revert "Fix typo"
This reverts commit 1c6002f3f1.
2023-03-28 19:48:21 +08:00
duzx16 c6790a09f0 Fix typos
Move model instantiation
2023-03-28 19:45:17 +08:00
Zhengxiao Du 43b7241e67
Merge pull request #241 from Cherrysaber/dev-multi-gpus
Add Multi-GPU support
2023-03-28 19:33:04 +08:00
duzx16 1c6002f3f1 Fix typo 2023-03-28 19:29:41 +08:00
Zhengxiao Du 3e9e02fb1d
Merge pull request #235 from imClumsyPanda/main
update api.py
2023-03-28 19:28:56 +08:00
duzx16 bc973445c8 Merge branch 'main' into dev_api 2023-03-28 19:28:26 +08:00
duzx16 9addb875ca Add links 2023-03-28 16:58:38 +08:00
saber c313af0639 Add support for manual device_map; auto-config if None 2023-03-27 22:20:23 +08:00
saber c31d9c0984 Move import statement into function to avoid dependency 2023-03-27 22:11:57 +08:00
saber 6a5267aef7 bugfix: linux多卡部署时weight,input不在同一device上,导致RuntimeError 2023-03-27 20:51:05 +08:00
saber 8101d75ab8 fix typo 2023-03-26 15:29:15 +08:00
saber d9c45f0286 Update README 2023-03-26 15:26:38 +08:00
saber 8826b947c3 多GPU支持, 模型文件夹没有index.json会自动保存模型到multi_gpu_model_cache_dir以支持多GPU 2023-03-26 15:13:44 +08:00
saber 4ee042a8e6 将配置device_map的逻辑抽离, 根据gpu数量自动配置device_map,并且自动适配所有模型 2023-03-26 13:44:10 +08:00
Cherrysaber dc1a3df1ec
Merge pull request #1 from ChuangLee/main
多卡版本
2023-03-26 13:26:33 +08:00
littlepanda0716 023c46a317 update api.py 2023-03-25 18:59:11 +08:00
duzx16 963d5645ef Merge branch 'main' of github.com:THUDM/ChatGLM-6B 2023-03-25 10:02:58 +08:00
duzx16 ff260ffa51 Update README.md 2023-03-25 10:02:34 +08:00
Zhengxiao Du bc02336f3e
Merge pull request #221 from ZhangErling/dev_api
修复api服务启动错误
2023-03-24 22:13:06 +08:00
Zhengxiao Du 697ee00263
Merge pull request #223 from mojianhao/patch-1
Update api.py
2023-03-24 22:12:40 +08:00
holk-h bf39dac067 Support stream out interruption by using Ctrl+C 2023-03-24 18:34:09 +08:00
Jianhao Mo 1047e446e5
Update api.py
bug fix
2023-03-24 16:45:24 +08:00