mirror of https://github.com/hpcaitech/ColossalAI
aibig-modeldata-parallelismdeep-learningdistributed-computingfoundation-modelsheterogeneous-traininghpcinferencelarge-scalemodel-parallelismpipeline-parallelism
You can not select more than 25 topics
Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
Ofey Chan
c7d68b2c2c
|
6 months ago | |
|---|---|---|
| .. | ||
| Chat | 6 months ago | |
| Colossal-LLaMA-2 | ||
| ColossalEval | ||
| ColossalQA | 10 months ago | |
| README.md | ||
README.md
Applications
This directory contains the applications that are powered by Colossal-AI.
The list of applications include:
- Colossal-LLaMA-2: Continual Pre-training of LLaMA-2.
- ColossalEval: Evaluation Pipeline for LLMs.
- ColossalChat: Replication of ChatGPT with RLHF.
- FastFold: Optimizing AlphaFold (Biomedicine) Training and Inference on GPU Clusters.
- ColossalQA: Document Retrieval Conversation System
Please note that the
Chatbotapplication is migrated from the originalChatGPTfolder.
You can find more example code for base models and functions in the Examples directory.