History

Yuanchen b397104438 [Colossal-Llama-2] Add finetuning Colossal-Llama-2 example (#4878 ) * Add finetuning Colossal-Llama-2 example * Add finetuning Colossal-Llama-2 example 2 * Add finetuning Colossal-Llama-2 example and support NEFTuning * Add inference example and refine neftune * Modify readme file * update the imports --------- Co-authored-by: Xu Yuanchen <yuanchen.xu00@gmail.com> Co-authored-by: Camille Zhong <44392324+Camille7777@users.noreply.github.com>		2023-12-07 14:02:03 +08:00
..
Chat	fix wrong EOS token in ColossalChat	2023-11-14 10:49:49 +08:00
Colossal-LLaMA-2	[Colossal-Llama-2] Add finetuning Colossal-Llama-2 example (#4878 )	2023-12-07 14:02:03 +08:00
ColossalEval	[format] applied code formatting on changed files in pull request 5115 (#5118 )	2023-11-29 13:39:14 +08:00
ColossalQA	[doc] fix colossalqa document (#5146 )	2023-12-01 21:39:53 +08:00
README.md	[Feature] Add document retrieval QA (#5020 )	2023-11-23 10:33:48 +08:00

Applications

This directory contains the applications that are powered by Colossal-AI.

The list of applications include:

Colossal-LLaMA-2: Continual Pre-training of LLaMA-2.
ColossalEval: Evaluation Pipeline for LLMs.
ColossalChat: Replication of ChatGPT with RLHF.
FastFold: Optimizing AlphaFold (Biomedicine) Training and Inference on GPU Clusters.
ColossalQA: Document Retrieval Conversation System

Please note that the Chatbot application is migrated from the original ChatGPT folder.

You can find more example code for base models and functions in the Examples directory.