mirror of https://github.com/hpcaitech/ColossalAI
You can not select more than 25 topics
Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
Super Daniel
6d559ea614
|
2 years ago | |
|---|---|---|
| .. | ||
| README.md | ||
| auto_ckpt_demo.ipynb | 2 years ago | |
| auto_parallel_demo.py | ||
| bench_utils.py | 2 years ago | |
README.md
Train ResNet on CIFAR10 with auto_parallel
Prepare Dataset
We use CIFAR10 dataset in this example. The dataset will be downloaded to ./data by default.
If you wish to use customized directory for the dataset. You can set the environment variable DATA via the following command.
export DATA=/path/to/data
Run on 2*2 device mesh
colossalai run --nproc_per_node 4 auto_parallel_demo.py