github
/
ColossalAI
mirror of https://github.com/hpcaitech/ColossalAI
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
ColossalAI/examples/language/palm/palm_config.py

6 lines
101 B
Python
Raw Blame History

SEQ_LENGTH = 1024
BATCH_SIZE = 4
NUM_EPOCHS = 4
TPDEGREE = 2
USE_SHARD_INIT = False
placement = 'cpu'
Reference in New Issue View Git Blame Copy Permalink