github
/
ColossalAI
mirror of https://github.com/hpcaitech/ColossalAI
1
0
Fork 0
Code Issues Projects Releases Wiki Activity

[example] fixed opt model downloading from huggingface

pull/3065/head
Tomek 2023-03-09 03:47:41 +01:00 committed by GitHub
parent 2ca9728cbb
commit af3888481d
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
examples/language/opt/train_gemini_opt.py
View File

@ -177,7 +177,7 @@ def main():
default_dist_spec = ShardSpec([-1], [world_size]) if args.shardinit else None default_dist_spec = ShardSpec([-1], [world_size]) if args.shardinit else None
# build model # build model
if args.model_name_or_path is None or args.model_name_or_path == 'facebook/opt-13b': if args.model_name_or_path is None:
# currently, there has a bug in pretrained opt-13b # currently, there has a bug in pretrained opt-13b
# we can not import it until huggingface fix it # we can not import it until huggingface fix it
logger.info("Train a new model from scratch", ranks=[0]) logger.info("Train a new model from scratch", ranks=[0])