History

YeAnbang 0b2d55c4ab Support overall loss, update KTO logging		2024-08-02 06:51:38 +00:00
..
Colossal-LLaMA	[Feature] Add a switch to control whether the model checkpoint needs to be saved after each epoch ends (#5941 )	2024-07-26 11:15:20 +08:00
ColossalChat	Support overall loss, update KTO logging	2024-08-02 06:51:38 +00:00
ColossalEval	[feat] Dist Loader for Eval (#5950 )	2024-08-02 10:06:25 +08:00
ColossalMoE	…
ColossalQA	…
README.md	…

Applications

This directory contains the applications that are powered by Colossal-AI.

The list of applications include:

Open-Sora: Revealing Complete Model Parameters, Training Details, and Everything for Sora-like Video Generation Models
Colossal-LLaMA: Continual Pre-training and Supervisied Fine-tuning of LLaMA2 / LLaMA3.
ColossalEval: Evaluation Pipeline for LLMs.
ColossalChat: Replication of ChatGPT with RLHF.
FastFold: Optimizing AlphaFold (Biomedicine) Training and Inference on GPU Clusters.
ColossalQA: Document Retrieval Conversation System
SwiftInfer: Breaks the Length Limit of LLM Inference for Multi-Round Conversations

Please note that the Chatbot application is migrated from the original ChatGPT folder.

You can find more example code for base models and functions in the Examples directory.