2 3. Developer Docs

Frank Lee edited this page 2023-03-07 11:42:12 +08:00

Table of Contents

• 📖 Overall Design
• ⚡ Gemini
• ⚡ Tensor Parallelism
• ⚡ Pipeline Parallelism
• ⚡ Auto Parallelism
• ⚡ Auto Activation Checkpoint

📖 Overall Design

To be added.

⚡ Gemini

⚡ Tensor Parallelism

⚡ Pipeline Parallelism

⚡ Auto Parallelism

⚡ Auto Activation Checkpoint

Written by the Colossal-AI community with love 💙