mirror of https://github.com/hpcaitech/ColossalAI
[NFC] fix paper link
parent
cefc29ff06
commit
9833d814d5
|
@ -83,7 +83,7 @@ Colossal-AI 为您提供了一系列并行训练组件。我们的目标是让
|
|||
- 流水线并行
|
||||
- 1维, [2维](https://arxiv.org/abs/2104.05343), [2.5维](https://arxiv.org/abs/2105.14500), [3维](https://arxiv.org/abs/2105.14450) 张量并行
|
||||
- [序列并行](https://arxiv.org/abs/2105.13120)
|
||||
- [零冗余优化器 (ZeRO)](https://arxiv.org/abs/2108.05818)
|
||||
- [零冗余优化器 (ZeRO)](https://arxiv.org/abs/1910.02054)
|
||||
- 异构内存管理
|
||||
- [PatrickStar](https://arxiv.org/abs/2108.05818)
|
||||
- 使用友好
|
||||
|
|
|
@ -85,7 +85,7 @@ distributed training in a few lines.
|
|||
- Pipeline Parallelism
|
||||
- 1D, [2D](https://arxiv.org/abs/2104.05343), [2.5D](https://arxiv.org/abs/2105.14500), [3D](https://arxiv.org/abs/2105.14450) Tensor Parallelism
|
||||
- [Sequence Parallelism](https://arxiv.org/abs/2105.13120)
|
||||
- [Zero Redundancy Optimizer (ZeRO)](https://arxiv.org/abs/2108.05818)
|
||||
- [Zero Redundancy Optimizer (ZeRO)](https://arxiv.org/abs/1910.02054)
|
||||
|
||||
- Heterogeneous Memory Menagement
|
||||
- [PatrickStar](https://arxiv.org/abs/2108.05818)
|
||||
|
|
Loading…
Reference in New Issue