mirror of https://github.com/hpcaitech/ColossalAI
aibig-modeldata-parallelismdeep-learningdistributed-computingfoundation-modelsheterogeneous-traininghpcinferencelarge-scalemodel-parallelismpipeline-parallelism
You can not select more than 25 topics
Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
Orion-Zheng
43ad0d9ef0
|
1 year ago | |
|---|---|---|
| .. | ||
| Chat | 1 year ago | |
| Colossal-LLaMA-2 | 1 year ago | |
| ColossalEval | 1 year ago | |
| README.md | 1 year ago | |
README.md
Applications
This directory contains the applications that are powered by Colossal-AI.
The list of applications include:
- Colossal-LLaMA-2: Continual Pre-training of LLaMA-2.
- ColossalEval: Evaluation Pipeline for LLMs.
- ColossalChat: Replication of ChatGPT with RLHF.
- FastFold: Optimizing AlphaFold (Biomedicine) Training and Inference on GPU Clusters.
Please note that the
Chatbotapplication is migrated from the originalChatGPTfolder.
You can find more example code for base models and functions in the Examples directory.