mirror of https://github.com/hpcaitech/ColossalAI
aibig-modeldata-parallelismdeep-learningdistributed-computingfoundation-modelsheterogeneous-traininghpcinferencelarge-scalemodel-parallelismpipeline-parallelism
You can not select more than 25 topics
Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
pre-commit-ci[bot]
7c2f79fa98
|
5 months ago | |
---|---|---|
.. | ||
Colossal-LLaMA | ||
ColossalChat | 5 months ago | |
ColossalEval | 5 months ago | |
ColossalMoE | ||
ColossalQA | 5 months ago | |
README.md |
README.md
Applications
This directory contains the applications that are powered by Colossal-AI.
The list of applications include:
- Open-Sora: Revealing Complete Model Parameters, Training Details, and Everything for Sora-like Video Generation Models
- Colossal-LLaMA: Continual Pre-training and Supervisied Fine-tuning of LLaMA2 / LLaMA3.
- ColossalEval: Evaluation Pipeline for LLMs.
- ColossalChat: Replication of ChatGPT with RLHF.
- FastFold: Optimizing AlphaFold (Biomedicine) Training and Inference on GPU Clusters.
- ColossalQA: Document Retrieval Conversation System
- SwiftInfer: Breaks the Length Limit of LLM Inference for Multi-Round Conversations
Please note that the
Chatbot
application is migrated from the originalChatGPT
folder.
You can find more example code for base models and functions in the Examples directory.