History

Camille Zhong 4b8312c08e fix sft single turn inference example (#5416 )		2024-03-01 17:27:50 +08:00
..
Chat	[Chat] fix sft loss nan (#5345 )	2024-02-01 14:25:16 +08:00
Colossal-LLaMA-2	fix sft single turn inference example (#5416 )	2024-03-01 17:27:50 +08:00
ColossalEval	[eval] update llama npu eval (#5366 )	2024-02-06 10:53:03 +08:00
ColossalMoE	[moe] fix mixtral optim checkpoint (#5344 )	2024-02-07 19:21:02 +08:00
ColossalQA	fix auto loading gpt2 tokenizer (#5279 )	2024-01-18 14:08:29 +08:00
README.md	[doc] SwiftInfer release (#5236 )	2024-01-08 09:55:12 +08:00

Applications

This directory contains the applications that are powered by Colossal-AI.

The list of applications include:

Colossal-LLaMA-2: Continual Pre-training of LLaMA-2.
ColossalEval: Evaluation Pipeline for LLMs.
ColossalChat: Replication of ChatGPT with RLHF.
FastFold: Optimizing AlphaFold (Biomedicine) Training and Inference on GPU Clusters.
ColossalQA: Document Retrieval Conversation System
SwiftInfer: Breaks the Length Limit of LLM Inference for Multi-Round Conversations

Please note that the Chatbot application is migrated from the original ChatGPT folder.

You can find more example code for base models and functions in the Examples directory.