2023-02-09 06:21:38 +00:00
|
|
|
|
# 安装
|
2023-03-07 10:04:10 +00:00
|
|
|
|
|
|
|
|
|
环境要求:
|
|
|
|
|
|
|
|
|
|
- PyTorch >= 1.11 (PyTorch 2.x 正在适配中)
|
|
|
|
|
- Python >= 3.7
|
|
|
|
|
- CUDA >= 11.0
|
2023-04-10 09:37:16 +00:00
|
|
|
|
- [NVIDIA GPU Compute Capability](https://developer.nvidia.com/cuda-gpus) >= 7.0 (V100/RTX20 and higher)
|
|
|
|
|
- Linux OS
|
2023-03-09 10:10:45 +00:00
|
|
|
|
|
2023-03-07 10:04:10 +00:00
|
|
|
|
如果你遇到安装问题,可以向本项目 [反馈](https://github.com/hpcaitech/ColossalAI/issues/new/choose)。
|
2023-02-09 06:21:38 +00:00
|
|
|
|
|
|
|
|
|
## 从PyPI上安装
|
|
|
|
|
|
|
|
|
|
你可以PyPI上使用以下命令直接安装Colossal-AI。
|
|
|
|
|
|
|
|
|
|
```shell
|
|
|
|
|
pip install colossalai
|
|
|
|
|
```
|
|
|
|
|
|
2023-03-07 10:04:10 +00:00
|
|
|
|
**注:现在只支持Linux。**
|
|
|
|
|
|
2023-02-09 06:21:38 +00:00
|
|
|
|
如果你想同时安装PyTorch扩展的话,可以添加`CUDA_EXT=1`。如果不添加的话,PyTorch扩展会在运行时自动安装。
|
|
|
|
|
|
|
|
|
|
```shell
|
|
|
|
|
CUDA_EXT=1 pip install colossalai
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
## 从源安装
|
|
|
|
|
|
[doc] update booster tutorials (#3718)
* [booster] update booster tutorials#3717
* [booster] update booster tutorials#3717, fix
* [booster] update booster tutorials#3717, update setup doc
* [booster] update booster tutorials#3717, update setup doc
* [booster] update booster tutorials#3717, update setup doc
* [booster] update booster tutorials#3717, update setup doc
* [booster] update booster tutorials#3717, update setup doc
* [booster] update booster tutorials#3717, update setup doc
* [booster] update booster tutorials#3717, rename colossalai booster.md
* [booster] update booster tutorials#3717, rename colossalai booster.md
* [booster] update booster tutorials#3717, rename colossalai booster.md
* [booster] update booster tutorials#3717, fix
* [booster] update booster tutorials#3717, fix
* [booster] update tutorials#3717, update booster api doc
* [booster] update tutorials#3717, modify file
* [booster] update tutorials#3717, modify file
* [booster] update tutorials#3717, modify file
* [booster] update tutorials#3717, modify file
* [booster] update tutorials#3717, modify file
* [booster] update tutorials#3717, modify file
* [booster] update tutorials#3717, modify file
* [booster] update tutorials#3717, fix reference link
* [booster] update tutorials#3717, fix reference link
* [booster] update tutorials#3717, fix reference link
* [booster] update tutorials#3717, fix reference link
* [booster] update tutorials#3717, fix reference link
* [booster] update tutorials#3717, fix reference link
* [booster] update tutorials#3717, fix reference link
* [booster] update tutorials#3713
* [booster] update tutorials#3713, modify file
2023-05-18 03:41:56 +00:00
|
|
|
|
> 此文档将与版本库的主分支保持一致。如果您遇到任何问题,欢迎给我们提 issue。
|
2023-02-09 06:21:38 +00:00
|
|
|
|
|
|
|
|
|
```shell
|
|
|
|
|
git clone https://github.com/hpcaitech/ColossalAI.git
|
|
|
|
|
cd ColossalAI
|
|
|
|
|
|
|
|
|
|
# install dependency
|
|
|
|
|
pip install -r requirements/requirements.txt
|
|
|
|
|
|
|
|
|
|
# install colossalai
|
[doc] update booster tutorials (#3718)
* [booster] update booster tutorials#3717
* [booster] update booster tutorials#3717, fix
* [booster] update booster tutorials#3717, update setup doc
* [booster] update booster tutorials#3717, update setup doc
* [booster] update booster tutorials#3717, update setup doc
* [booster] update booster tutorials#3717, update setup doc
* [booster] update booster tutorials#3717, update setup doc
* [booster] update booster tutorials#3717, update setup doc
* [booster] update booster tutorials#3717, rename colossalai booster.md
* [booster] update booster tutorials#3717, rename colossalai booster.md
* [booster] update booster tutorials#3717, rename colossalai booster.md
* [booster] update booster tutorials#3717, fix
* [booster] update booster tutorials#3717, fix
* [booster] update tutorials#3717, update booster api doc
* [booster] update tutorials#3717, modify file
* [booster] update tutorials#3717, modify file
* [booster] update tutorials#3717, modify file
* [booster] update tutorials#3717, modify file
* [booster] update tutorials#3717, modify file
* [booster] update tutorials#3717, modify file
* [booster] update tutorials#3717, modify file
* [booster] update tutorials#3717, fix reference link
* [booster] update tutorials#3717, fix reference link
* [booster] update tutorials#3717, fix reference link
* [booster] update tutorials#3717, fix reference link
* [booster] update tutorials#3717, fix reference link
* [booster] update tutorials#3717, fix reference link
* [booster] update tutorials#3717, fix reference link
* [booster] update tutorials#3713
* [booster] update tutorials#3713, modify file
2023-05-18 03:41:56 +00:00
|
|
|
|
CUDA_EXT=1 pip install .
|
2023-02-09 06:21:38 +00:00
|
|
|
|
```
|
|
|
|
|
|
[doc] update booster tutorials (#3718)
* [booster] update booster tutorials#3717
* [booster] update booster tutorials#3717, fix
* [booster] update booster tutorials#3717, update setup doc
* [booster] update booster tutorials#3717, update setup doc
* [booster] update booster tutorials#3717, update setup doc
* [booster] update booster tutorials#3717, update setup doc
* [booster] update booster tutorials#3717, update setup doc
* [booster] update booster tutorials#3717, update setup doc
* [booster] update booster tutorials#3717, rename colossalai booster.md
* [booster] update booster tutorials#3717, rename colossalai booster.md
* [booster] update booster tutorials#3717, rename colossalai booster.md
* [booster] update booster tutorials#3717, fix
* [booster] update booster tutorials#3717, fix
* [booster] update tutorials#3717, update booster api doc
* [booster] update tutorials#3717, modify file
* [booster] update tutorials#3717, modify file
* [booster] update tutorials#3717, modify file
* [booster] update tutorials#3717, modify file
* [booster] update tutorials#3717, modify file
* [booster] update tutorials#3717, modify file
* [booster] update tutorials#3717, modify file
* [booster] update tutorials#3717, fix reference link
* [booster] update tutorials#3717, fix reference link
* [booster] update tutorials#3717, fix reference link
* [booster] update tutorials#3717, fix reference link
* [booster] update tutorials#3717, fix reference link
* [booster] update tutorials#3717, fix reference link
* [booster] update tutorials#3717, fix reference link
* [booster] update tutorials#3713
* [booster] update tutorials#3713, modify file
2023-05-18 03:41:56 +00:00
|
|
|
|
如果您不想安装和启用 CUDA 内核融合(使用融合优化器时强制安装),您可以不添加`CUDA_EXT=1`:
|
2023-02-09 06:21:38 +00:00
|
|
|
|
|
|
|
|
|
```shell
|
[doc] update booster tutorials (#3718)
* [booster] update booster tutorials#3717
* [booster] update booster tutorials#3717, fix
* [booster] update booster tutorials#3717, update setup doc
* [booster] update booster tutorials#3717, update setup doc
* [booster] update booster tutorials#3717, update setup doc
* [booster] update booster tutorials#3717, update setup doc
* [booster] update booster tutorials#3717, update setup doc
* [booster] update booster tutorials#3717, update setup doc
* [booster] update booster tutorials#3717, rename colossalai booster.md
* [booster] update booster tutorials#3717, rename colossalai booster.md
* [booster] update booster tutorials#3717, rename colossalai booster.md
* [booster] update booster tutorials#3717, fix
* [booster] update booster tutorials#3717, fix
* [booster] update tutorials#3717, update booster api doc
* [booster] update tutorials#3717, modify file
* [booster] update tutorials#3717, modify file
* [booster] update tutorials#3717, modify file
* [booster] update tutorials#3717, modify file
* [booster] update tutorials#3717, modify file
* [booster] update tutorials#3717, modify file
* [booster] update tutorials#3717, modify file
* [booster] update tutorials#3717, fix reference link
* [booster] update tutorials#3717, fix reference link
* [booster] update tutorials#3717, fix reference link
* [booster] update tutorials#3717, fix reference link
* [booster] update tutorials#3717, fix reference link
* [booster] update tutorials#3717, fix reference link
* [booster] update tutorials#3717, fix reference link
* [booster] update tutorials#3713
* [booster] update tutorials#3713, modify file
2023-05-18 03:41:56 +00:00
|
|
|
|
pip install .
|
2023-02-09 06:21:38 +00:00
|
|
|
|
```
|
2023-03-09 10:10:45 +00:00
|
|
|
|
|
2023-05-25 06:14:34 +00:00
|
|
|
|
如果您在使用CUDA 10.2,您仍然可以从源码安装ColossalA。但是您需要手动下载cub库并将其复制到相应的目录。
|
|
|
|
|
|
|
|
|
|
```bash
|
|
|
|
|
# clone the repository
|
|
|
|
|
git clone https://github.com/hpcaitech/ColossalAI.git
|
|
|
|
|
cd ColossalAI
|
|
|
|
|
|
|
|
|
|
# download the cub library
|
|
|
|
|
wget https://github.com/NVIDIA/cub/archive/refs/tags/1.8.0.zip
|
|
|
|
|
unzip 1.8.0.zip
|
|
|
|
|
cp -r cub-1.8.0/cub/ colossalai/kernel/cuda_native/csrc/kernels/include/
|
|
|
|
|
|
|
|
|
|
# install
|
|
|
|
|
CUDA_EXT=1 pip install .
|
|
|
|
|
```
|
|
|
|
|
|
2023-03-09 10:10:45 +00:00
|
|
|
|
<!-- doc-test-command: echo "installation.md does not need test" -->
|