mirror of https://github.com/hpcaitech/ColossalAI
aibig-modeldata-parallelismdeep-learningdistributed-computingfoundation-modelsheterogeneous-traininghpcinferencelarge-scalemodel-parallelismpipeline-parallelism
You can not select more than 25 topics
Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
Yuanchen
abe071b663
|
1 year ago | |
---|---|---|
.. | ||
Chat | 1 year ago | |
Colossal-LLaMA-2 | 1 year ago | |
ColossalEval | 1 year ago | |
README.md | 1 year ago |
README.md
Applications
This directory contains the applications that are powered by Colossal-AI.
The list of applications include:
- Colossal-LLaMA-2: Continual Pre-training of LLaMA-2.
- ColossalEval: Evaluation Pipeline for LLMs.
- ColossalChat: Replication of ChatGPT with RLHF.
- FastFold: Optimizing AlphaFold (Biomedicine) Training and Inference on GPU Clusters.
Please note that the
Chatbot
application is migrated from the originalChatGPT
folder.
You can find more example code for base models and functions in the Examples directory.