mirror of https://github.com/hpcaitech/ColossalAI
2 lines
124 B
Bash
2 lines
124 B
Bash
|
colossalai run --nproc_per_node=4 train_gpt.py --config ./configs/gpt2_small_zero3_pp1d.py --from_torch --use_dummy_dataset
|