github
/
InternLM
mirror of https://github.com/InternLM/InternLM
1
0
Fork 0
Code Issues Projects Releases Wiki Activity

doc fix

pull/507/head
lijiaxing 2023-11-21 17:14:53 +08:00
parent 8bd85a6f5e
commit 4aa7c21a76
2 changed files with 6 additions and 4 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

5
doc/en/train_performance.md
View File

@ -98,6 +98,7 @@ Test configuration:
| :-------: | :-----: | | :-------: | :-----: |
| branch | develop | | branch | develop |
| commit id | 2b984ff | | commit id | 2b984ff |
| tag | v0.2.1dev20231121 |
| GPU | A800 | | GPU | A800 |
| Checkpoint| True | | Checkpoint| True |
| micro_bsz | 1 | | micro_bsz | 1 |
@ -128,7 +129,7 @@ parallel = dict(
) )
``` ```
Pre-training test: Pre-training & Fine-tuning test:
|model|Number of GPU|zero1|tp|pp|fsdp|GPU Memory (GB)| |model|Number of GPU|zero1|tp|pp|fsdp|GPU Memory (GB)|
|:-:|:-:|:-:|:-:|:-:|:-:|:-:| |:-:|:-:|:-:|:-:|:-:|:-:|:-:|
| 7B | 3 | -1 | 1 | 3 |False| 75 | | 7B | 3 | -1 | 1 | 3 |False| 75 |
@ -154,4 +155,4 @@ Web_demo test:
|model|GPU|GPU Memory (GB)|System Memory (MB)| |model|GPU|GPU Memory (GB)|System Memory (MB)|
|:-:|:-:|:-:|:-:| |:-:|:-:|:-:|:-:|
| 7B | A800 | 14.5 | 2465 | | 7B | A800 | 14.5 | 2465 |
| 7B | A800 | 39 | 9547 | | 20B | A800 | 39 | 9547 |

5
doc/train_performance.md
View File

@ -94,6 +94,7 @@ InternLM中`zero1`的配置决定了优化器状态的分配范围。
| :-------: | :-----: | | :-------: | :-----: |
| 分支 | develop | | 分支 | develop |
| commit id | 2b984ff | | commit id | 2b984ff |
| tag | v0.2.1dev20231121 |
| 显卡 | A800 | | 显卡 | A800 |
| 重计算 | True | | 重计算 | True |
| micro_bsz | 1 | | micro_bsz | 1 |
@ -124,7 +125,7 @@ parallel = dict(
) )
``` ```
预训练测试： 预训练和微调测试：
|模型|卡数|zero1|tp|pp|fsdp|显存（GB）| |模型|卡数|zero1|tp|pp|fsdp|显存（GB）|
|:-:|:-:|:-:|:-:|:-:|:-:|:-:| |:-:|:-:|:-:|:-:|:-:|:-:|:-:|
| 7B | 3 | -1 | 1 | 3 |False| 75 | | 7B | 3 | -1 | 1 | 3 |False| 75 |
@ -150,4 +151,4 @@ Web_demo 测试:
|模型|显卡|显存（GB）|内存（MB）| |模型|显卡|显存（GB）|内存（MB）|
|:-:|:-:|:-:|:-:| |:-:|:-:|:-:|:-:|
| 7B | A800 | 14.5 | 2465 | | 7B | A800 | 14.5 | 2465 |
| 7B | A800 | 39 | 9547 | | 20B | A800 | 39 | 9547 |