ColossalAI/requirements/requirements-test.txt

diffusers
fbgemm-gpu==0.2.0
pytest
coverage==7.2.3
git+https://github.com/hpcaitech/pytest-testmon
torchvision
transformers==4.33.0
timm
titans
torchaudio
torchx-nightly==2022.6.29 # torchrec 0.2.0 requires torchx-nightly. This package is updated every day. We fix the version to a specific date to avoid breaking changes.
torchrec==0.2.0
contexttimer
einops
triton==2.0.0.dev20221202
requests==2.27.1 # downgrade to avoid huggingface error https://github.com/huggingface/transformers/issues/17611
SentencePiece
ninja
flash_attn==2.0.5
datasets
#auto-gptq now not support torch1.12
[tests] diffuser models in model zoo (#3136) * [tests] diffuser models in model zoo * remove useless code * [tests] add diffusers to requirement-test 2023-03-14 09:20:28 +00:00			`diffusers`
[CI] downgrade fbgemm. (#1778) 2022-10-31 10:18:45 +00:00			`fbgemm-gpu==0.2.0`
Migrated project 2021-10-28 16:21:23 +00:00			`pytest`
[workflow] fixed testmon cache in build CI (#3806) * [workflow] fixed testmon cache in build CI * polish code 2023-05-24 06:59:40 +00:00			`coverage==7.2.3`
[devops] update torch version of CI (#3725) * [test] fix flop tensor test * [test] fix autochunk test * [test] fix lazyinit test * [devops] update torch version of CI * [devops] enable testmon * [devops] fix ci * [devops] fix ci * [test] fix checkpoint io test * [test] fix cluster test * [test] fix timm test * [devops] fix ci * [devops] fix ci * [devops] fix ci * [devops] fix ci * [devops] force sync to test ci * [test] skip fsdp test 2023-05-15 09:20:56 +00:00			`git+https://github.com/hpcaitech/pytest-testmon`
[dependency] removed torchvision (#833) * [dependency] removed torchvision * fixed transforms 2022-04-22 07:24:35 +00:00			`torchvision`
[shardformer] update llama2/opt finetune example and fix llama2 policy (#4645) * [shardformer] update shardformer readme [shardformer] update shardformer readme [shardformer] update shardformer readme * [shardformer] update llama2/opt finetune example and shardformer update to llama2 * [shardformer] update llama2/opt finetune example and shardformer update to llama2 * [shardformer] update llama2/opt finetune example and shardformer update to llama2 * [shardformer] change dataset * [shardformer] change dataset * [shardformer] fix CI * [shardformer] fix * [shardformer] fix * [shardformer] fix * [shardformer] fix * [shardformer] fix [example] update opt example [example] resolve comments fix fix 2023-09-09 14:45:36 +00:00			`transformers==4.33.0`
[fx] fixed unit tests for torch 1.12 (#1327) 2022-07-15 10:22:15 +00:00			`timm`
[titans]remove model zoo (#1042) * [CLI] add CLI launcher * Revert "[CLI] add CLI launcher" This reverts commit df7e6506d4500af6a9220ef7fe4d3c7b1daebd4c. * rm model zoo 2022-05-31 02:40:47 +00:00			`titans`
[fx] add torchaudio test (#1369) * [fx]add torchaudio test * [fx]add torchaudio test * [fx] add torchaudio test * [fx] add torchaudio test * [fx] add torchaudio test * [fx] add torchaudio test * [fx] add torchaudio test * [fx] add torchaudio test and test patches * Delete ~ * [fx] add patches and patches test * [fx] add patches and patches test * [fx] fix patches * [fx] fix rnn patches * [fx] fix rnn patches * [fx] fix rnn patches * [fx] fix rnn patches * [fx] merge upstream * [fx] fix import errors 2022-07-27 03:03:14 +00:00			`torchaudio`
[devops] update torch version of CI (#3725) * [test] fix flop tensor test * [test] fix autochunk test * [test] fix lazyinit test * [devops] update torch version of CI * [devops] enable testmon * [devops] fix ci * [devops] fix ci * [test] fix checkpoint io test * [test] fix cluster test * [test] fix timm test * [devops] fix ci * [devops] fix ci * [devops] fix ci * [devops] fix ci * [devops] force sync to test ci * [test] skip fsdp test 2023-05-15 09:20:56 +00:00			`torchx-nightly==2022.6.29 # torchrec 0.2.0 requires torchx-nightly. This package is updated every day. We fix the version to a specific date to avoid breaking changes.`
[CI] downgrade fbgemm. (#1778) 2022-10-31 10:18:45 +00:00			`torchrec==0.2.0`
[FAW] add cache manager for the cached embedding (#1419) 2022-08-09 07:17:17 +00:00			`contexttimer`
[feat] add flash attention (#1762) 2022-10-26 08:15:52 +00:00			`einops`
[test] fixed the triton version for testing (#2608) 2023-02-07 05:49:38 +00:00			`triton==2.0.0.dev20221202`
[test] refactor tests with spawn (#3452) * [test] added spawn decorator * polish code * polish code * polish code * polish code * polish code * polish code 2023-04-06 06:51:35 +00:00			`requests==2.27.1 # downgrade to avoid huggingface error https://github.com/huggingface/transformers/issues/17611`
[shardformer] shardformer support t5 model (#3994) test t5 2023-06-15 08:50:08 +00:00			`SentencePiece`
[kernel] updated unittests for coloattention (#4389) Updated coloattention tests of checking outputs and gradients 2023-08-09 06:24:45 +00:00			`ninja`
[misc] update requirements 2023-08-15 09:07:29 +00:00			`flash_attn==2.0.5`
[shardformer] support inplace sharding (#4251) * [shardformer] embedding support inplace sharding * [shardformer] linear support inplace sharding * [shardformer] layernorm support inplace sharding * [shardformer] qkv support inplace sharding * [test] update shardformer layer test * [shardformer] fix shared param sharding * [shardformer] fix bert policy * [shardformer] fix bloom policy * [shardformer] fix llama policy * [shardformer] fix opt policy * [shardformer] fix t5 policy * [shardformer] fix fused qkv linear * [shardformer] fix bugs * force sync * [test] fix bugs * [test] fix transformer version 2023-07-20 02:39:06 +00:00			`datasets`
[feature] add gptq for inference (#4754) * [gptq] add gptq kernel (#4416) * add gptq * refactor code * fix tests * replace auto-gptq * rname inferance/quant * refactor test * add auto-gptq as an option * reset requirements * change assert and check auto-gptq * add import warnings * change test flash attn version * remove example * change requirements of flash_attn * modify tests * [skip ci] change requirements-test * [gptq] faster gptq cuda kernel (#4494) * [skip ci] add cuda kernels * add license * [skip ci] fix max_input_len * format files & change test size * [skip ci] * [gptq] add gptq tensor parallel (#4538) * add gptq tensor parallel * add gptq tp * delete print * add test gptq check * add test auto gptq check * [gptq] combine gptq and kv cache manager (#4706) * combine gptq and kv cache manager * add init bits * delete useless code * add model path * delete usless print and update test * delete usless import * move option gptq to shard config * change replace linear to shardformer * update bloom policy * delete useless code * fix import bug and delete uselss code * change colossalai/gptq to colossalai/quant/gptq * update import linear for tests * delete useless code and mv gptq_kernel to kernel directory * fix triton kernel * add triton import 2023-09-22 03:02:50 +00:00			`#auto-gptq now not support torch1.12`