Commit Graph

6 Commits (743e464ecc16e40d2cf91c9c399e91e2aef8e6a1)

Author SHA1 Message Date
zhengjie.xu 743e464ecc
Update web_demo.py
1. 实测 `from transformers import AutoModelForCausalLM, AutoTokenizer` 必须先引入 `AutoTokenizer` 再引入`AutoModelForCausalLM` 否则会报以下错

```bash
Traceback (most recent call last):
  File "/root/.conda/envs/InternLM/lib/python3.10/site-packages/streamlit/runtime/scriptrunner/script_runner.py", line 552, in _run_script
    exec(code, module.__dict__)
  File "/root/code/InternLM2/web_demo.py", line 10, in <module>
    from transformers import AutoModelForCausalLM, AutoTokenizer
ImportError: cannot import name 'AutoModelForCausalLM' from 'transformers' (/root/.local/lib/python3.10/site-packages/transformers/__init__.py)
load model begin.
```

2. 必须用 steamlit 命令,不能用 python 命令运行 web_demo.py 否则会报以下错

``` bash
2024-01-19 15:02:13.807 Session state does not function when running a script without `streamlit run`
Traceback (most recent call last):
  File "/root/.conda/envs/InternLM/lib/python3.10/site-packages/streamlit/runtime/state/session_state.py", line 378, in __getitem__
    return self._getitem(widget_id, key)
  File "/root/.conda/envs/InternLM/lib/python3.10/site-packages/streamlit/runtime/state/session_state.py", line 423, in _getitem
    raise KeyError
KeyError

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/root/.conda/envs/InternLM/lib/python3.10/site-packages/streamlit/runtime/state/session_state_proxy.py", line 119, in __getattr__
    return self[key]
  File "/root/.conda/envs/InternLM/lib/python3.10/site-packages/streamlit/runtime/state/session_state_proxy.py", line 90, in __getitem__
    return get_session_state()[key]
  File "/root/.conda/envs/InternLM/lib/python3.10/site-packages/streamlit/runtime/state/safe_session_state.py", line 113, in __getitem__
    return self._state[key]
  File "/root/.conda/envs/InternLM/lib/python3.10/site-packages/streamlit/runtime/state/session_state.py", line 380, in __getitem__
    raise KeyError(_missing_key_error_message(key))
KeyError: 'st.session_state has no key "messages". Did you forget to initialize it? More info: https://docs.streamlit.io/library/advanced-features/session-state#initialization'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "//root/code/InternLM2/web_demo.py", line 251, in <module>
    main()
  File "//root/code/InternLM2/web_demo.py", line 214, in main
    for message in st.session_state.messages:
  File "/root/.conda/envs/InternLM/lib/python3.10/site-packages/streamlit/runtime/state/session_state_proxy.py", line 121, in __getattr__
    raise AttributeError(_missing_attr_error_message(key))
AttributeError: st.session_state has no attribute "messages". Did you forget to initialize it? More info: https://docs.streamlit.io/library/advanced-features/session-state#initialization
```
2024-01-19 15:41:53 +08:00
Wenwei Zhang f08a18b9b7
[Fix]: Update web demo to be self-contained (#624) 2024-01-19 11:24:22 +08:00
LYMDLUT e408af7fb5
[Fix]: Update end token id in web_demo.py (#611) 2024-01-18 10:33:09 +08:00
Yang Gao 896bac06a6
[Doc]: Update README (#599) 2024-01-17 13:07:35 +08:00
Wenwei Zhang 468982bc76
[Doc]: Resolve comments in documentation (#587)
* fix typos and try pass lint

* fix wrong path in CI

* fix wrong path in readme

* update lint doc

* update doc

* update doc
2024-01-17 10:47:06 +08:00
Wenwei Zhang dbec726c62
Update main branch and docs (#585)
* [Refactor]: refactor with pure documentations and examples

* update model information

* update model information

* Check-in lmdeploy user guide

* Update chat format doc

* update cn doc

* clean doc
2024-01-17 09:46:11 +08:00