ColossalAI/examples/language/openmoe/requirements.txt

6 lines
92 B
Plaintext

colossalai >= 0.3.3
torch >= 1.8.1
transformers >= 4.20.0, <= 4.34.0
sentencepiece
datasets