hwaking
0903d2377f
Update web_demo2.py
...
当前MAX_BOXES与MAX_TURNS不生效导致单次对话不终止显存不断增加最后显存溢出问题,修改最大对话轮数和最大历史对话数量使其生效,逻辑为历史最大对话框记录轮数达到MAX_BOXES时截断历史对话为最近MAX_TURNS数。
2 years ago
duzx16
4f95c09a3b
Add multi-gpu deployment
2 years ago
duzx16
90f2e47f54
Merge branch 'dev' into dev_multi_gpu
...
# Conflicts:
# README.md
# api.py
# cli_demo.py
# requirements.txt
2 years ago
Bluzy
c9f68cf39a
update web_demo
2 years ago
saber
8101d75ab8
fix typo
2 years ago
saber
8826b947c3
多GPU支持, 模型文件夹没有index.json会自动保存模型到multi_gpu_model_cache_dir以支持多GPU
2 years ago
Cherrysaber
dc1a3df1ec
Merge pull request #1 from ChuangLee/main
...
多卡版本
2 years ago
duzx16
5513dd7d2c
Delete session_state show
2 years ago
lichuang
de9f26c201
初次提交,支持多卡部署。
2 years ago
AdamBear
ee76342382
merge
2 years ago
AdamBear
5040849822
Merge branch 'master' of https://github.com/AdamBear/ChatGLM-6B
2 years ago
AdamBear
ef6b3ff35e
support stream chat
2 years ago
duzx16
f63af3515f
Delete unused code
...
Fix model name
2 years ago
AdamBear
905aa26b91
Create web_demo2.py
...
Add a steamlit based demo web_demo2.py for better UI.
need to install streamlit and streamlit-chat component fisrt:
pip install streamlit
pip install streamlit-chat
then run with the following:
streamlit run web_demo2.py --server.port 6006
2 years ago