You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
ColossalAI/examples/language/openmoe/requirements.txt

6 lines
81 B

colossalai >= 0.3.3
torch >= 1.8.1
transformers >= 4.20.0
sentencepiece
datasets