e1cefaef6b
fix huggingface link ( #219 )
2023-08-22 22:20:01 +08:00
716131e477
introduce how to deploy 4-bit quantized internlm model ( #207 )
2023-08-22 11:31:01 +08:00
075648cd70
update readme related to internlm-chat-7v-v1.1 ( #214 )
2023-08-22 08:08:44 +08:00
58108413bd
Update readme for news of InternLM-Chat-7B-v1.1 and Lagent ( #213 )
...
* update readme
* fix typo
2023-08-22 07:46:01 +08:00
cc3c48ae47
test(ci_scripts): add load ckpt cases ( #208 )
...
* fix format
* add scripts for load ckpt case
* update test config
* debug:use var in json
* fix syntax error
* export pythonpath
* use absolute path
* use father path of workspace
* debug load new ckpt
* change data path
* add train folder
* fix code format
* fix pylint warning
---------
Co-authored-by: wangmengke <wangmengke@pjlab.org.cn>
2023-08-21 15:24:43 +08:00
0600b42c01
refactor(tools): move interface.py and import it to web_demo ( #195 )
...
* move interface.py and import it to web_demo
* typo
2023-08-14 22:32:29 +08:00
ccb06a98e4
test(ci_scripts): add timeout settings and clean work after the slurm job ( #185 )
...
* restore pr test on develop branch
* add mask
* add post action to cancel slurm job
* remove readonly attribute on job log
* add debug info
* debug job log
* try stdin
* use stdin
* set default value avoid error
* try setting readonly on job log
* performance echo
* remove debug info
* use squeue to check slurm job status
* restore the lossed parm
* litmit retry times
* use exclusive to avoid port already in use
* optimize loop body
* remove partition
* add {} for variables
* set env variable for slurm partition
---------
Co-authored-by: qa-caif-cicd <qa-caif-cicd@pjlab.org.cn>
2023-08-11 17:09:56 +08:00
7cfea534e7
[feat]: add pal reasoning script ( #163 )
...
* [Feat] Add PAL inference script
* Update README.md
* Update tools/README.md
Co-authored-by: BigDong <yudongwang1226@gmail.com>
* Update tools/pal_inference.py
Co-authored-by: BigDong <yudongwang1226@gmail.com>
* Update pal script
* Update README.md
* restore .ore-commit-config.yaml
* Update tools/README.md
Co-authored-by: BigDong <yudongwang1226@gmail.com>
* Update tools/README.md
Co-authored-by: BigDong <yudongwang1226@gmail.com>
* Update pal inference script
* Update READMD.md
* Update internlm/utils/interface.py
Co-authored-by: Wenwei Zhang <40779233+ZwwWayne@users.noreply.github.com>
* Update pal script
* Update pal script
* Update script
* Add docstring
* Update format
* Update script
* Update script
* Update script
---------
Co-authored-by: BigDong <yudongwang1226@gmail.com>
Co-authored-by: Wenwei Zhang <40779233+ZwwWayne@users.noreply.github.com>
2023-08-10 17:53:46 +08:00
d28816a499
feat(bot): Create .owners.yml for Auto Assign ( #176 )
...
* Create .owners.yml: for issue/pr assign automatically
* Update .owners.yml
* Update .owners.yml
fix typo
2023-08-10 12:11:30 +08:00
e4c0651b96
feat(CI_workflow): Add PR & Issue auto remove workflow ( #184 )
...
* feat(ci_workflow): Add PR & Issue auto remove workflow
Add a workflow for stale PR & Issue auto remove
- pr & issue well be labeled as stale for inactive in 7 days
- staled PR & Issue well be remove in 7 days
- run this workflow every day on 1:30 a.m.
* Update stale.yml
2023-08-09 16:26:05 +08:00
f1a7949185
feat(profiling): add a simple memory profiler ( #89 )
...
* feat(profiling): add simple memory profiler
* feat(profiling): add profiling argument
2023-08-08 13:10:01 +08:00
06274e64d7
test(ci_scripts): add install requirements automaticlly,trigger event about lint check and other optimizations ( #174 )
...
* add pull_request in lint check
* use default variables in ci_scripts
* fix format
* check and install requirements automaticlly
* fix format
---------
Co-authored-by: qa-caif-cicd <qa-caif-cicd@pjlab.org.cn>
2023-08-04 11:09:46 +08:00
585071c95b
test(ci_scripts): clean test data after test, remove unnecessary global variables, and other optimizations ( #165 )
...
* test: optimization of ci scripts(variables, test data cleaning, etc).
* chore(workflows): disable ci job on push.
* fix: update partition
2023-08-03 11:26:51 +08:00
7fbf85eac9
use llm partition ( #159 )
...
Co-authored-by: qa-caif-cicd <qa-caif-cicd@pjlab.org.cn>
2023-08-01 17:49:01 +08:00
fbe6ef1da5
[Doc] update deployment guide to keep consistency with lmdeploy ( #136 )
...
* update deployment guide
* fix error
2023-07-31 14:42:07 +08:00
6b6295aea3
Feat add checkpoint fraction ( #151 )
...
* feat(config): add checkpoint_fraction into config
* feat: remove checkpoint_fraction from configs/7B_sft.py
---------
Co-authored-by: wangguoteng.p <wangguoteng925@qq.com>
2023-07-31 13:57:01 +08:00
2fee4220a6
Doc: add twitter link ( #141 )
2023-07-27 15:24:50 +08:00
fb84c9548f
fix web_demo cache accelerate ( #133 )
2023-07-26 03:04:56 +08:00
03851ea2fa
add demo test ( #132 )
...
Co-authored-by: qa-caif-cicd <qa-caif-cicd@pjlab.org.cn>
2023-07-25 19:51:50 +08:00
26205c1edf
feat(solver): fix code to adapt to torch2.0 and provide docker images ( #128 )
...
* feat(solver): fix code to adapt to torch2.0
* docs(install.md): publish internlm environment image
* docs(install.md): update dependency packages version
* docs(install.md): update default image
---------
Co-authored-by: 黄婷 <huangting3@CN0014010744M.local>
2023-07-25 19:34:52 +08:00
084a841799
variables are not printly as expect ( #114 )
2023-07-25 18:06:37 +08:00
c52a47a993
fix AutoModel map in convert2hf.py ( #116 )
2023-07-24 12:07:47 +08:00
cde899f3e5
docs(LICENSE): add license ( #125 )
...
* add license of colossalai and flash-attn
* fix lint
* modify the name
2023-07-24 11:59:56 +08:00
acea4554ec
docs(install.md): update dependency package transformers version to >= 4.28.0 ( #124 )
...
Co-authored-by: 黄婷 <huangting3@CN0014010744M.local>
2023-07-24 11:33:26 +08:00
1095263082
[Fix]Fix wrong string cutoff in the script for sft text tokenizing ( #106 )
2023-07-19 12:12:41 +08:00
efbf533570
Update web_demo.py ( #97 )
...
Remove meaningless log.
2023-07-17 23:20:35 +08:00
1ebc3cca99
set the value of repetition_penalty to 1.0 to avoid random outputs ( #99 )
2023-07-17 23:19:48 +08:00
e746754b6e
delete torch_dtype of README's example code ( #100 )
2023-07-17 23:19:19 +08:00
0c1060435d
Use tempfile for convert2hf.py ( #23 )
...
Fix https://github.com/InternLM/InternLM/issues/50
2023-07-17 21:08:10 +08:00
59f4727675
[Enchancement] add more options for issue template ( #77 )
...
* [Enchancement] add more options for issue template
* update qustion icon
* fix link
2023-07-17 12:54:54 +08:00
cb991b6865
use fp16 in instruction ( #80 )
2023-07-14 17:56:15 +08:00
fda99947ad
add repetition_penalty in GenerationConfig in web_demo.py ( #48 )
...
Co-authored-by: YWMditto <862779238@qq.com>
2023-07-14 17:03:52 +08:00
be50c02949
[Docs]: add Japanese README ( #43 )
...
* Add Japanese README
* Update README-ja-JP.md
replace message
* Update README-ja-JP.md
2023-07-14 16:29:34 +08:00
28bc0ebebe
[Doc] Add wechat and discord link in readme ( #78 )
...
* Doc：add wechat and discord link
* Doc：update wechat and discord link
* Doc：update wechat and discord link
* Doc：update wechat and discord link
* Doc：update wechat and discord link
* Doc：update wechat and discord link
* Doc：update wechat and discord link
* Doc：update wechat and discord link
* Doc：update wechat and discord link
* Doc：update wechat and discord link
* Doc：update wechat and discord link
2023-07-14 16:19:10 +08:00
73de6622a9
fix(readme, requirements): fix typo at Chinese readme and select a lower version of transformers ( #73 )
...
* fix a typo in readme
* in order to find InternLMTokenizer, select a lower version of Transformers
---------
Co-authored-by: gouhchangjiang <gouhchangjiang@gmail.com>
2023-07-13 18:44:33 +08:00
555ed60a2c
fix(tokenizer): refactor tokenizer and update usage in readme ( #51 )
...
* update tokenizer example
2023-07-13 17:16:27 +08:00
7f242f644b
fix issue templates ( #65 )
2023-07-13 00:12:38 +08:00
6150e4daed
fix/fix_submodule_err ( #61 )
...
* fix/fix_submodule_err
---------
Co-authored-by: ChenQiaoling00 <qiaoling_chen@u.nus.edu>
2023-07-12 18:59:31 +08:00
c7287e2584
feat(readme): add huggingface url ( #52 )
...
Co-authored-by: wangguoteng.p <wangguoteng@sensetime.com>
2023-07-11 22:04:46 +08:00
c18bec9361
fix[performance]: fix the performance evaluation mistakes ( #40 )
...
* fix(no_pp_scheduler): drop out and label if not used
* Update train_performance.md
* Update readme with new tested data
* update some typos
* doc(performance): fix some typos
2023-07-08 20:42:34 +08:00
4a3d15650e
fix(no_pp_scheduler): drop model out data and label if not used ( #39 )
...
* fix(no_pp_scheduler): drop out and label if not used
* Update train_performance.md
* Update readme with new tested data
* update some typos
2023-07-08 18:55:31 +08:00
dfb2751f00
add commercial license application form ( #38 )
2023-07-08 10:37:11 +08:00
81b10e81d9
[Doc]: Add issue template ( #34 )
2023-07-08 00:37:24 +08:00
c690bf3779
[Doc]: fix citation blocks ( #32 )
2023-07-08 00:17:41 +08:00
2066b36693
add citation ( #30 )
2023-07-07 22:58:48 +08:00
912fc8f8aa
doc: update the training examples ( #27 )
...
* doc: update the training examples
* update README
* change all "++++" log
* Update pylint
* solve lint err
2023-07-07 15:54:09 +08:00
745d2b911a
Fix readme about conversion to transformers ( #25 )
...
* add links for 8k
* fix acknowledgement
* modified readme for convert_hf
2023-07-07 13:38:06 +08:00
ed04c7edb0
Add 8k transformers link ( #14 )
...
* add links for 8k
* fix acknowledgement
2023-07-06 22:00:50 +08:00
09440d055c
Merge pull request #10 from RangeKing/fix-typos
...
Doc(README.md): Fix typos
2023-07-06 21:53:30 +08:00
21b44ad938
Update README.md
2023-07-06 17:46:51 +08:00
loveSnowBest