github
/
InternLM
mirror of https://github.com/InternLM/InternLM
1
0
Fork 0
Code Issues Projects Releases Wiki Activity

variables are not printly as expect (#114)

pull/133/head
Zaida Zhou 2023-07-25 18:06:37 +08:00 committed by GitHub
parent c52a47a993
commit 084a841799
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 2 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

4
tools/alpaca_tokenizer.py
View File

@ -160,5 +160,5 @@ if __name__ == "__main__":
train_tokens, valid_tokens, train_samples, valid_samples = dump_bin_meta_bin(
samples, args.output_path, args.split_ratio
)
print(f"number of train dataset: {train_samples}, " "number of train dataset token: {train_tokens}")
print(f"number of validation dataset: {valid_samples}, " "number of validation dataset token: {valid_tokens}")
print(f"number of train dataset: {train_samples}, number of train dataset token: {train_tokens}")
print(f"number of validation dataset: {valid_samples}, number of validation dataset token: {valid_tokens}")