github
/
ColossalAI
mirror of https://github.com/hpcaitech/ColossalAI
1
0
Fork 0
Code Issues Projects Releases Wiki Activity

[tutorial] updated hybrid parallel readme (#1928) 

* [tutorial] updated hybrid parallel readme

* polish code
pull/1943/head
Frank Lee 2022-11-13 03:25:01 +08:00 committed by GitHub
parent 807cbdb87d
commit 0486048453
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
examples/tutorial/hybrid_parallel/README.md
View File

@ -28,5 +28,5 @@ Current configuration setting on `config.py` is TP=2, PP=2.
colossalai run --nproc_per_node 4 train.py --config config.py
# train with synthetic data
colossalai run --nproc_per_node 4 train.py --config config.py
colossalai run --nproc_per_node 4 train.py --config config.py -s
```