diff --git a/examples/language/gpt/README.md b/examples/language/gpt/README.md index fe7b23beb..a35408152 100644 --- a/examples/language/gpt/README.md +++ b/examples/language/gpt/README.md @@ -19,11 +19,8 @@ conda install pytorch==1.12.0 torchvision==0.13.0 torchaudio==0.12.0 cudatoolkit pip install torch==1.12.0+cu113 torchvision==0.13.0+cu113 torchaudio==0.12.0 --extra-index-url https://download.pytorch.org/whl/cu113 ``` -### Install [Colossal-AI v0.1.12](https://colossalai.org/download/) From Official Website +### [Install Colossal-AI](https://github.com/hpcaitech/ColossalAI#installation) -```bash -pip install colossalai==0.1.12+torch1.12cu11.3 -f https://release.colossalai.org -``` ### Install requirements @@ -31,7 +28,7 @@ pip install colossalai==0.1.12+torch1.12cu11.3 -f https://release.colossalai.org pip install -r requirements.txt ``` -This is just an example that we download PyTorch=1.12.0, CUDA=11.6 and colossalai=0.1.12+torch1.12cu11.3. You can download another version of PyTorch and its corresponding ColossalAI version. Just make sure that the version of ColossalAI is at least 0.1.10, PyTorch is at least 1.8.1 and transformers is at least 4.231. +This is just an example that we download PyTorch=1.12.0, CUDA=11.6 and colossalai. You can download another version of PyTorch and its corresponding ColossalAI version. Just make sure that the version of ColossalAI is at least 0.1.10, PyTorch is at least 1.8.1 and transformers is at least 4.231. If you want to test ZeRO1 and ZeRO2 in Colossal-AI, you need to ensure Colossal-AI>=0.1.12. ## Dataset