Update README

pull/406/head
duzx16 2023-07-27 19:42:47 +08:00
parent 882956c809
commit f01259efb4
1 changed files with 7 additions and 6 deletions

View File

@ -57,12 +57,13 @@ ChatGLM2-6B 开源模型旨在与开源社区一起推动大模型技术发展
### C-Eval
| Model | Average | STEM | Social Sciences | Humanities | Others |
| ----- | ---- | ---- | ----- |------------|--------|
| ChatGLM-6B | 38.9 | 33.3 | 48.3 | 41.3 | 38.0 |
| ChatGLM2-6B (base) | 51.7 | 48.6 | 60.5 | 51.3 | 49.8 |
| ChatGLM2-6B | 50.1 | 46.4 | 60.4 | 50.6 | 46.9 |
| ChatGLM2-12B (base) | 61.6 | 55.4 | 73.7 | 64.2 | 59.4 |
| Model | Average | STEM | Social Sciences | Humanities | Others |
| ----- |---------|-------| ----- |------------|--------|
| ChatGLM-6B | 38.9 | 33.3 | 48.3 | 41.3 | 38.0 |
| ChatGLM2-6B (base) | 51.7 | 48.6 | 60.5 | 51.3 | 49.8 |
| ChatGLM2-6B | 50.1 | 46.4 | 60.4 | 50.6 | 46.9 |
| ChatGLM2-12B (base) | 61.6 | 55.4 | 73.7 | 64.2 | 59.4 |
| ChatGLM2-12B | 57.0 | 52.1 | 69.3 | 58.5 | 53.2 |
> Chat 模型使用 zero-shot CoT 的方法测试Base 模型使用 few-shot answer only 的方法测试