mirror of https://github.com/hpcaitech/ColossalAI
aibig-modeldata-parallelismdeep-learningdistributed-computingfoundation-modelsheterogeneous-traininghpcinferencelarge-scalemodel-parallelismpipeline-parallelism
You can not select more than 25 topics
Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
digger yu
9110406a47
|
12 months ago | |
---|---|---|
.. | ||
Chat | 1 year ago | |
Colossal-LLaMA-2 | 12 months ago | |
ColossalEval | 12 months ago | |
ColossalQA | 12 months ago | |
README.md | 1 year ago |
README.md
Applications
This directory contains the applications that are powered by Colossal-AI.
The list of applications include:
- Colossal-LLaMA-2: Continual Pre-training of LLaMA-2.
- ColossalEval: Evaluation Pipeline for LLMs.
- ColossalChat: Replication of ChatGPT with RLHF.
- FastFold: Optimizing AlphaFold (Biomedicine) Training and Inference on GPU Clusters.
- ColossalQA: Document Retrieval Conversation System
Please note that the
Chatbot
application is migrated from the originalChatGPT
folder.
You can find more example code for base models and functions in the Examples directory.