github
/
InternLM
mirror of https://github.com/InternLM/InternLM
1
0
Fork 0
Code Issues Projects Releases Wiki Activity

update auto_resume 7B_sft.py

pull/380/head
Guoteng 2023-09-27 21:37:43 +08:00 committed by GitHub
parent fd7138af38
commit 3d8690bf8b
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 2 additions and 3 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

5
configs/7B_sft.py
View File

@ -34,9 +34,8 @@ ckpt = dict(
# training interruptions/hangs caused by hardware failures, using a scheduling system (such as k8s/slurm) # training interruptions/hangs caused by hardware failures, using a scheduling system (such as k8s/slurm)
# with an automatic restart mechanism upon training reboot. # with an automatic restart mechanism upon training reboot.
# Please be aware that if `auto_resume` is not set (its default value is True), it will not load the checkpoint # Please be aware that if `auto_resume` is not set (its default value is True), it will not load the checkpoint
# path specified in `load_ckpt_info` by default. If you wish to initialize your model weights from another model, # path specified in `load_ckpt_info` by default.
# you must set `auto_resume` to False. # If you want to initialize your model weights from another model, you must set `auto_resume` to False.
# To initialize from another pre-trained model, set 'auto_resume' to False.
# If you want to train from scratch, please set load_ckpt_info=None. # If you want to train from scratch, please set load_ckpt_info=None.
auto_resume=False, auto_resume=False,
checkpoint_every=CHECKPOINT_EVERY, checkpoint_every=CHECKPOINT_EVERY,