Browse Source

[doc] add GPU cloud playground (#5851)

* [doc] add GPU cloud playground

* [doc] add GPU cloud playground

* [doc] add GPU cloud playground

* [doc] add GPU cloud playground

* [doc] add GPU cloud playground

* [doc] add GPU cloud playground

* [doc] add GPU cloud playground

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
pull/5852/head
binmakeswell 5 months ago committed by GitHub
parent
commit
4ccaaaab63
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
  1. 10
      README.md
  2. 6
      applications/Colossal-LLaMA/README.md
  3. 6
      applications/ColossalEval/README.md
  4. 9
      applications/README.md
  5. 11
      docs/README-zh-Hans.md
  6. 8
      examples/README.md

10
README.md

@ -9,6 +9,7 @@
<a href="https://www.colossalai.org/"> Documentation </a> | <a href="https://www.colossalai.org/"> Documentation </a> |
<a href="https://github.com/hpcaitech/ColossalAI/tree/main/examples"> Examples </a> | <a href="https://github.com/hpcaitech/ColossalAI/tree/main/examples"> Examples </a> |
<a href="https://github.com/hpcaitech/ColossalAI/discussions"> Forum </a> | <a href="https://github.com/hpcaitech/ColossalAI/discussions"> Forum </a> |
<a href="https://cloud.luchentech.com/">GPU Cloud Playground </a> |
<a href="https://hpc-ai.com/blog"> Blog </a></h3> <a href="https://hpc-ai.com/blog"> Blog </a></h3>
[![GitHub Repo stars](https://img.shields.io/github/stars/hpcaitech/ColossalAI?style=social)](https://github.com/hpcaitech/ColossalAI/stargazers) [![GitHub Repo stars](https://img.shields.io/github/stars/hpcaitech/ColossalAI?style=social)](https://github.com/hpcaitech/ColossalAI/stargazers)
@ -132,6 +133,8 @@ distributed training and inference in a few lines.
[[blog]](https://hpc-ai.com/blog/open-sora-from-hpc-ai-tech-team-continues-open-source-generate-any-16-second-720p-hd-video-with-one-click-model-weights-ready-to-use) [[blog]](https://hpc-ai.com/blog/open-sora-from-hpc-ai-tech-team-continues-open-source-generate-any-16-second-720p-hd-video-with-one-click-model-weights-ready-to-use)
[[Model weights]](https://github.com/hpcaitech/Open-Sora?tab=readme-ov-file#model-weights) [[Model weights]](https://github.com/hpcaitech/Open-Sora?tab=readme-ov-file#model-weights)
[[Demo]](https://github.com/hpcaitech/Open-Sora?tab=readme-ov-file#-latest-demo) [[Demo]](https://github.com/hpcaitech/Open-Sora?tab=readme-ov-file#-latest-demo)
[[GPU Cloud Playground]](https://cloud.luchentech.com/)
[[OpenSora Image]](https://cloud.luchentech.com/doc/docs/image/open-sora/)
<div align="center"> <div align="center">
<a href="https://youtu.be/ilMQpU71ddI?si=J4JSPzZ03ycYmlki"> <a href="https://youtu.be/ilMQpU71ddI?si=J4JSPzZ03ycYmlki">
@ -143,6 +146,9 @@ distributed training and inference in a few lines.
### Colossal-LLaMA-2 ### Colossal-LLaMA-2
[[GPU Cloud Playground]](https://cloud.luchentech.com/)
[[LLaMA3 Image]](https://cloud.luchentech.com/doc/docs/image/llama)
- 7B: One half-day of training using a few hundred dollars yields similar results to mainstream large models, open-source and commercial-free domain-specific LLM solution. - 7B: One half-day of training using a few hundred dollars yields similar results to mainstream large models, open-source and commercial-free domain-specific LLM solution.
[[code]](https://github.com/hpcaitech/ColossalAI/tree/main/applications/Colossal-LLaMA-2) [[code]](https://github.com/hpcaitech/ColossalAI/tree/main/applications/Colossal-LLaMA-2)
[[blog]](https://www.hpc-ai.tech/blog/one-half-day-of-training-using-a-few-hundred-dollars-yields-similar-results-to-mainstream-large-models-open-source-and-commercial-free-domain-specific-llm-solution) [[blog]](https://www.hpc-ai.tech/blog/one-half-day-of-training-using-a-few-hundred-dollars-yields-similar-results-to-mainstream-large-models-open-source-and-commercial-free-domain-specific-llm-solution)
@ -275,6 +281,8 @@ Acceleration of [AlphaFold Protein Structure](https://alphafold.ebi.ac.uk/)
- 70 billion parameter LLaMA3 model training accelerated by 18% - 70 billion parameter LLaMA3 model training accelerated by 18%
[[code]](https://github.com/hpcaitech/ColossalAI/tree/main/examples/language/llama) [[code]](https://github.com/hpcaitech/ColossalAI/tree/main/examples/language/llama)
[[GPU Cloud Playground]](https://cloud.luchentech.com/)
[[LLaMA3 Image]](https://cloud.luchentech.com/doc/docs/image/llama)
### LLaMA2 ### LLaMA2
<p align="center"> <p align="center">
@ -385,6 +393,8 @@ Please visit our [documentation](https://www.colossalai.org/) and [examples](htt
- Large AI models inference speed doubled, compared to the offline inference performance of vLLM in some cases. - Large AI models inference speed doubled, compared to the offline inference performance of vLLM in some cases.
[[code]](https://github.com/hpcaitech/ColossalAI/tree/main/colossalai/inference) [[code]](https://github.com/hpcaitech/ColossalAI/tree/main/colossalai/inference)
[[blog]](https://hpc-ai.com/blog/colossal-inference) [[blog]](https://hpc-ai.com/blog/colossal-inference)
[[GPU Cloud Playground]](https://cloud.luchentech.com/)
[[LLaMA3 Image]](https://cloud.luchentech.com/doc/docs/image/llama)
### Grok-1 ### Grok-1
<p id="Grok-1" align="center"> <p id="Grok-1" align="center">

6
applications/Colossal-LLaMA/README.md

@ -2,6 +2,12 @@
<h1> <h1>
Colossal-LLaMA Colossal-LLaMA
</h1> </h1>
<h3>
<a href="https://cloud.luchentech.com/">GPU Cloud Playground </a> </a> |
<a href="https://cloud.luchentech.com/doc/docs/image/llama"> LLaMA3 Image </a>
</h3>
</div> </div>
## Table of Contents ## Table of Contents

6
applications/ColossalEval/README.md

@ -2,6 +2,12 @@
<h1> <h1>
<img src="https://github.com/hpcaitech/public_assets/blob/main/applications/colossal-llama-2/colossaleval.jpg?raw=true" width=800/> <img src="https://github.com/hpcaitech/public_assets/blob/main/applications/colossal-llama-2/colossaleval.jpg?raw=true" width=800/>
</h1> </h1>
<h3>
<a href="https://cloud.luchentech.com/">GPU Cloud Playground </a> </a> |
<a href="https://cloud.luchentech.com/doc/docs/image/colossal-eval"> Colossal-Eval Image </a>
</h3>
</div> </div>
## Table of Contents ## Table of Contents

9
applications/README.md

@ -2,6 +2,15 @@
This directory contains the applications that are powered by Colossal-AI. This directory contains the applications that are powered by Colossal-AI.
<div align="center">
<h3>
<a href="https://cloud.luchentech.com/">GPU Cloud Playground </a> </a> |
<a href="https://cloud.luchentech.com/doc/docs/intro"> Playground Document </a>
</h3>
</div>
The list of applications include: The list of applications include:
- [X] [Open-Sora](https://github.com/hpcaitech/Open-Sora): Revealing Complete Model Parameters, Training Details, and Everything for Sora-like Video Generation Models - [X] [Open-Sora](https://github.com/hpcaitech/Open-Sora): Revealing Complete Model Parameters, Training Details, and Everything for Sora-like Video Generation Models

11
docs/README-zh-Hans.md

@ -9,6 +9,7 @@
<a href="https://www.colossalai.org/"> 文档 </a> | <a href="https://www.colossalai.org/"> 文档 </a> |
<a href="https://github.com/hpcaitech/ColossalAI/tree/main/examples"> 例程 </a> | <a href="https://github.com/hpcaitech/ColossalAI/tree/main/examples"> 例程 </a> |
<a href="https://github.com/hpcaitech/ColossalAI/discussions"> 论坛 </a> | <a href="https://github.com/hpcaitech/ColossalAI/discussions"> 论坛 </a> |
<a href="https://cloud.luchentech.com/">潞晨云 </a> |
<a href="https://hpc-ai.com/blog"> 博客 </a></h3> <a href="https://hpc-ai.com/blog"> 博客 </a></h3>
[![GitHub Repo stars](https://img.shields.io/github/stars/hpcaitech/ColossalAI?style=social)](https://github.com/hpcaitech/ColossalAI/stargazers) [![GitHub Repo stars](https://img.shields.io/github/stars/hpcaitech/ColossalAI?style=social)](https://github.com/hpcaitech/ColossalAI/stargazers)
@ -127,6 +128,8 @@ Colossal-AI 为您提供了一系列并行组件。我们的目标是让您的
[[博客]](https://hpc-ai.com/blog/open-sora-from-hpc-ai-tech-team-continues-open-source-generate-any-16-second-720p-hd-video-with-one-click-model-weights-ready-to-use) [[博客]](https://hpc-ai.com/blog/open-sora-from-hpc-ai-tech-team-continues-open-source-generate-any-16-second-720p-hd-video-with-one-click-model-weights-ready-to-use)
[[模型权重]](https://github.com/hpcaitech/Open-Sora?tab=readme-ov-file#model-weights) [[模型权重]](https://github.com/hpcaitech/Open-Sora?tab=readme-ov-file#model-weights)
[[演示样例]](https://github.com/hpcaitech/Open-Sora?tab=readme-ov-file#-latest-demo) [[演示样例]](https://github.com/hpcaitech/Open-Sora?tab=readme-ov-file#-latest-demo)
[[潞晨云]](https://cloud.luchentech.com/)
[[OpenSora镜像]](https://cloud.luchentech.com/doc/docs/image/open-sora/)
<div align="center"> <div align="center">
<a href="https://www.bilibili.com/video/BV1Fm421G7bV"> <a href="https://www.bilibili.com/video/BV1Fm421G7bV">
@ -135,6 +138,8 @@ Colossal-AI 为您提供了一系列并行组件。我们的目标是让您的
</div> </div>
### Colossal-LLaMA-2 ### Colossal-LLaMA-2
[[潞晨云]](https://cloud.luchentech.com/)
[[LLaMA3 镜像]](https://cloud.luchentech.com/doc/docs/image/llama)
- 7B:千元预算半天训练,效果媲美主流大模型,开源可商用中文LLaMA-2 - 7B:千元预算半天训练,效果媲美主流大模型,开源可商用中文LLaMA-2
[[代码]](https://github.com/hpcaitech/ColossalAI/tree/main/applications/Colossal-LLaMA-2) [[代码]](https://github.com/hpcaitech/ColossalAI/tree/main/applications/Colossal-LLaMA-2)
@ -265,7 +270,9 @@ Colossal-AI 为您提供了一系列并行组件。我们的目标是让您的
</p> </p>
- 700亿参数LLaMA3训练加速18% - 700亿参数LLaMA3训练加速18%
[[code]](https://github.com/hpcaitech/ColossalAI/tree/main/examples/language/llama) [[代码]](https://github.com/hpcaitech/ColossalAI/tree/main/examples/language/llama)
[[潞晨云]](https://cloud.luchentech.com/)
[[LLaMA3 镜像]](https://cloud.luchentech.com/doc/docs/image/llama)
### LLaMA2 ### LLaMA2
<p align="center"> <p align="center">
@ -378,6 +385,8 @@ Colossal-AI 为您提供了一系列并行组件。我们的目标是让您的
- AI大模型推理速度部分接近翻倍,与vLLM的离线推理性能相比 - AI大模型推理速度部分接近翻倍,与vLLM的离线推理性能相比
[[代码]](https://github.com/hpcaitech/ColossalAI/tree/main/colossalai/inference) [[代码]](https://github.com/hpcaitech/ColossalAI/tree/main/colossalai/inference)
[[博客]](https://hpc-ai.com/blog/colossal-inference) [[博客]](https://hpc-ai.com/blog/colossal-inference)
[[潞晨云]](https://cloud.luchentech.com/)
[[LLaMA3 镜像]](https://cloud.luchentech.com/doc/docs/image/llama)
### Grok-1 ### Grok-1
<p id="Grok-1" align="center"> <p id="Grok-1" align="center">

8
examples/README.md

@ -1,4 +1,12 @@
# Colossal-AI Examples # Colossal-AI Examples
<div align="center">
<h3>
<a href="https://cloud.luchentech.com/">GPU Cloud Playground </a> </a> |
<a href="https://cloud.luchentech.com/doc/docs/intro"> Playground Document </a>
</h3>
</div>
## Table of Contents ## Table of Contents

Loading…
Cancel
Save