github
/
ColossalAI
mirror of https://github.com/hpcaitech/ColossalAI
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
Browse Source

script

pull/5190/head
Xuanlei Zhao 11 months ago
parent
d660a41850
commit
4922641098
2 changed files with 2 additions and 2 deletions
Whitespace
Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL
Unified View
Diff Options
Show Stats Download Patch File Download Diff File
  1. 2
      applications/ColossalMoE/infer.sh
  2. 2
      applications/ColossalMoE/train.sh

2
applications/ColossalMoE/infer.sh
Unescape View File

@ -1,5 +1,5 @@
NUM_GPU=2 NUM_GPU=2
MODEL="/home/zhaoxuanlei/.cache/huggingface/hub/models--mistralai--Mixtral-8x7B-v0.1/snapshots/58301445dc1378584211722b7ebf8743ec4e192b" MODEL="mistralai/Mixtral-8x7B-v0.1"
# ep # ep
torchrun --standalone --nproc_per_node $NUM_GPU infer.py \ torchrun --standalone --nproc_per_node $NUM_GPU infer.py \

2
applications/ColossalMoE/train.sh
Unescape View File

@ -1,5 +1,5 @@
NUM_GPU=8 NUM_GPU=8
MODEL="/home/zhaoxuanlei/.cache/huggingface/hub/models--mistralai--Mixtral-8x7B-v0.1/snapshots/58301445dc1378584211722b7ebf8743ec4e192b" MODEL="mistralai/Mixtral-8x7B-v0.1"
SEQ_LENGTH=2048 SEQ_LENGTH=2048
BATCH_SIZE=1 BATCH_SIZE=1
LR=0.00001 LR=0.00001

Write Preview
Loading…
Cancel
Save