Commit Graph

14 Commits (401bf3a8a7dd8a26fba189551dccfc61a7079b4e)

Author SHA1 Message Date
hwaking 0903d2377f
Update web_demo2.py
当前MAX_BOXES与MAX_TURNS不生效导致单次对话不终止显存不断增加最后显存溢出问题,修改最大对话轮数和最大历史对话数量使其生效,逻辑为历史最大对话框记录轮数达到MAX_BOXES时截断历史对话为最近MAX_TURNS数。
2023-04-28 14:51:48 +08:00
duzx16 4f95c09a3b Add multi-gpu deployment 2023-04-16 21:37:33 +08:00
duzx16 90f2e47f54 Merge branch 'dev' into dev_multi_gpu
# Conflicts:
#	README.md
#	api.py
#	cli_demo.py
#	requirements.txt
2023-04-16 21:14:02 +08:00
Bluzy c9f68cf39a update web_demo 2023-04-07 11:19:43 +08:00
saber 8101d75ab8 fix typo 2023-03-26 15:29:15 +08:00
saber 8826b947c3 多GPU支持, 模型文件夹没有index.json会自动保存模型到multi_gpu_model_cache_dir以支持多GPU 2023-03-26 15:13:44 +08:00
Cherrysaber dc1a3df1ec
Merge pull request #1 from ChuangLee/main
多卡版本
2023-03-26 13:26:33 +08:00
duzx16 5513dd7d2c Delete session_state show 2023-03-23 14:46:05 +08:00
lichuang de9f26c201 初次提交,支持多卡部署。 2023-03-23 10:11:52 +08:00
AdamBear ee76342382 merge 2023-03-22 15:16:08 +08:00
AdamBear 5040849822 Merge branch 'master' of https://github.com/AdamBear/ChatGLM-6B 2023-03-22 15:13:22 +08:00
AdamBear ef6b3ff35e support stream chat 2023-03-22 15:11:21 +08:00
duzx16 f63af3515f Delete unused code
Fix model name
2023-03-17 23:02:44 +08:00
AdamBear 905aa26b91 Create web_demo2.py
Add a steamlit based demo web_demo2.py for better UI.
need to install streamlit and streamlit-chat component fisrt:
pip install streamlit
pip install streamlit-chat

then run with the following:
streamlit run web_demo2.py --server.port 6006
2023-03-17 10:32:06 +08:00