ColossalAI/examples/language/gpt/titans/test_ci.sh

2 lines
124 B
Bash

colossalai run --nproc_per_node=4 train_gpt.py --config ./configs/gpt2_small_zero3_pp1d.py --from_torch --use_dummy_dataset