github
/
ColossalAI
mirror of https://github.com/hpcaitech/ColossalAI
1
0
Fork 0
Code Issues Projects Releases Wiki Activity

[workflow] added conda cache and fixed no-compilation bug in release (#2005)

pull/2006/head
Frank Lee 2022-11-23 15:52:42 +08:00 committed by GitHub
parent 6cd784ffee
commit 7ad9bd14d8
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
2 changed files with 16 additions and 3 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

12
.github/workflows/release_bdist.yml vendored
View File

@ -64,9 +64,21 @@ jobs:
- name: Copy scripts and checkout - name: Copy scripts and checkout
run: | run: |
cp -r ./.github/workflows/scripts/* ./ cp -r ./.github/workflows/scripts/* ./
# link the cache diretories to current path
ln -s /github/home/conda_pkgs ./conda_pkgs
ln -s /github/home/pip_wheels ./pip_wheels ln -s /github/home/pip_wheels ./pip_wheels
# set the conda package path
echo pkgs_dirs:\n\t- $PWD/conda_pkgs > ~/.condarc
# set safe directory
git config --global --add safe.directory /__w/ColossalAI/ColossalAI git config --global --add safe.directory /__w/ColossalAI/ColossalAI
# check out
git checkout $git_ref git checkout $git_ref
# get cub package for cuda 10.2
wget https://github.com/NVIDIA/cub/archive/refs/tags/1.8.0.zip wget https://github.com/NVIDIA/cub/archive/refs/tags/1.8.0.zip
unzip 1.8.0.zip unzip 1.8.0.zip
env: env:

5
.github/workflows/scripts/build_colossalai_wheel.sh vendored
View File

@ -34,8 +34,9 @@ fi
python setup.py bdist_wheel python setup.py bdist_wheel
mv ./dist/* ./all_dist mv ./dist/* ./all_dist
# must remove build to enable compilation for
# cuda extension in the next build
rm -rf ./build
python setup.py clean python setup.py clean
conda deactivate conda deactivate
conda env remove -n $python_version conda env remove -n $python_version