mirror of https://github.com/hpcaitech/ColossalAI
aibig-modeldata-parallelismdeep-learningdistributed-computingfoundation-modelsheterogeneous-traininghpcinferencelarge-scalemodel-parallelismpipeline-parallelism
You can not select more than 25 topics
Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
20 lines
503 B
20 lines
503 B
pytest |
|
coverage==7.2.3 |
|
git+https://github.com/hpcaitech/pytest-testmon |
|
torchvision |
|
timm |
|
titans |
|
torchaudio>=0.13.1 |
|
torchx-nightly==2022.6.29 # torchrec 0.2.0 requires torchx-nightly. This package is updated every day. We fix the version to a specific date to avoid breaking changes. |
|
torchrec==0.2.0 |
|
contexttimer |
|
einops |
|
triton |
|
requests==2.27.1 # downgrade to avoid huggingface error https://github.com/huggingface/transformers/issues/17611 |
|
SentencePiece |
|
ninja |
|
flash_attn |
|
datasets |
|
pydantic |
|
ray |
|
peft>=0.7.1
|
|
|