mirror of https://github.com/hpcaitech/ColossalAI
[doc] update auto parallel paper link (#2686)
* [doc] update auto parallel paper link * [doc] update auto parallel paper linkpull/2689/head
parent
88416019e7
commit
46f20bac41
|
@ -102,7 +102,7 @@ Colossal-AI 为您提供了一系列并行组件。我们的目标是让您的
|
|||
- 1维, [2维](https://arxiv.org/abs/2104.05343), [2.5维](https://arxiv.org/abs/2105.14500), [3维](https://arxiv.org/abs/2105.14450) 张量并行
|
||||
- [序列并行](https://arxiv.org/abs/2105.13120)
|
||||
- [零冗余优化器 (ZeRO)](https://arxiv.org/abs/1910.02054)
|
||||
- [自动并行](https://github.com/hpcaitech/ColossalAI/tree/main/examples/language/gpt/auto_parallel_with_gpt)
|
||||
- [自动并行](https://arxiv.org/abs/2302.02599)
|
||||
- 异构内存管理
|
||||
- [PatrickStar](https://arxiv.org/abs/2108.05818)
|
||||
- 使用友好
|
||||
|
|
|
@ -104,7 +104,7 @@ distributed training and inference in a few lines.
|
|||
- 1D, [2D](https://arxiv.org/abs/2104.05343), [2.5D](https://arxiv.org/abs/2105.14500), [3D](https://arxiv.org/abs/2105.14450) Tensor Parallelism
|
||||
- [Sequence Parallelism](https://arxiv.org/abs/2105.13120)
|
||||
- [Zero Redundancy Optimizer (ZeRO)](https://arxiv.org/abs/1910.02054)
|
||||
- [Auto-Parallelism](https://github.com/hpcaitech/ColossalAI/tree/main/examples/language/gpt/auto_parallel_with_gpt)
|
||||
- [Auto-Parallelism](https://arxiv.org/abs/2302.02599)
|
||||
|
||||
- Heterogeneous Memory Management
|
||||
- [PatrickStar](https://arxiv.org/abs/2108.05818)
|
||||
|
|
Loading…
Reference in New Issue