github
/
ColossalAI
mirror of https://github.com/hpcaitech/ColossalAI
1
0
Fork 0
Code Issues Projects Releases Wiki Activity

fixed utils docstring and add example to readme (#200)

pull/201/head
Frank Lee 2022-02-03 11:37:17 +08:00 committed by GitHub
parent b9a761b9b8
commit 812357d63c
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
2 changed files with 6 additions and 6 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

10
README.md
View File

@ -3,7 +3,11 @@
[![logo](./docs/images/Colossal-AI_logo.png)](https://www.colossalai.org/) [![logo](./docs/images/Colossal-AI_logo.png)](https://www.colossalai.org/)
<div align="center"> <div align="center">
<h3> <a href="https://arxiv.org/abs/2110.14883"> Paper </a> | <a href="https://www.colossalai.org/"> Documentation </a> | <a href="https://github.com/hpcaitech/ColossalAI/discussions"> Forum </a> | <a href="https://medium.com/@hpcaitech"> Blog </a></h3> <h3> <a href="https://arxiv.org/abs/2110.14883"> Paper </a> |
<a href="https://www.colossalai.org/"> Documentation </a> |
<a href="https://github.com/hpcaitech/ColossalAI-Examples"> Examples </a> |
<a href="https://github.com/hpcaitech/ColossalAI/discussions"> Forum </a> |
<a href="https://medium.com/@hpcaitech"> Blog </a></h3>
[![Build](https://github.com/hpcaitech/ColossalAI/actions/workflows/PR_CI.yml/badge.svg)](https://github.com/hpcaitech/ColossalAI/actions/workflows/PR_CI.yml) [![Build](https://github.com/hpcaitech/ColossalAI/actions/workflows/PR_CI.yml/badge.svg)](https://github.com/hpcaitech/ColossalAI/actions/workflows/PR_CI.yml)
[![Documentation](https://readthedocs.org/projects/colossalai/badge/?version=latest)](https://colossalai.readthedocs.io/en/latest/?badge=latest) [![Documentation](https://readthedocs.org/projects/colossalai/badge/?version=latest)](https://colossalai.readthedocs.io/en/latest/?badge=latest)
@ -38,10 +42,6 @@ pip install -v --no-cache-dir --global-option="--cuda_ext" .
pip install colossalai pip install colossalai
``` ```
## Documentation
- [Documentation](https://www.colossalai.org/)
## Use Docker ## Use Docker

2
colossalai/utils/data_sampler/data_parallel_sampler.py
View File

@ -123,7 +123,7 @@ def get_dataloader(dataset,
.. note:: When pipeline parallel is enabled, shuffle cannot be True as it will result in mismatch between input data .. note:: When pipeline parallel is enabled, shuffle cannot be True as it will result in mismatch between input data
on the 1st stage and label on the last stage on the 1st stage and label on the last stage
:param dataset: A :class:`utils.data.dataset dataset` :param dataset: A :class:`torch.utils.data.Dataset` object
:param shuffle: Whether to shuffle the dataset :param shuffle: Whether to shuffle the dataset
:param seed: Random worker seed, defaults to 1024 :param seed: Random worker seed, defaults to 1024
:param add_sampler: Add DistributedDataParallelSampelr to the dataset :param add_sampler: Add DistributedDataParallelSampelr to the dataset