mirror of https://github.com/hpcaitech/ColossalAI
![]() * [pre-commit.ci] pre-commit autoupdate updates: - [github.com/PyCQA/autoflake: v2.2.1 → v2.3.1](https://github.com/PyCQA/autoflake/compare/v2.2.1...v2.3.1) - [github.com/pycqa/isort: 5.12.0 → 5.13.2](https://github.com/pycqa/isort/compare/5.12.0...5.13.2) - [github.com/psf/black-pre-commit-mirror: 23.9.1 → 24.4.2](https://github.com/psf/black-pre-commit-mirror/compare/23.9.1...24.4.2) - [github.com/pre-commit/mirrors-clang-format: v13.0.1 → v18.1.7](https://github.com/pre-commit/mirrors-clang-format/compare/v13.0.1...v18.1.7) - [github.com/pre-commit/pre-commit-hooks: v4.3.0 → v4.6.0](https://github.com/pre-commit/pre-commit-hooks/compare/v4.3.0...v4.6.0) * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci --------- Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> |
||
---|---|---|
.. | ||
Colossal-LLaMA | ||
ColossalChat | ||
ColossalEval | ||
ColossalMoE | ||
ColossalQA | ||
README.md |
README.md
Applications
This directory contains the applications that are powered by Colossal-AI.
The list of applications include:
- Open-Sora: Revealing Complete Model Parameters, Training Details, and Everything for Sora-like Video Generation Models
- Colossal-LLaMA: Continual Pre-training and Supervisied Fine-tuning of LLaMA2 / LLaMA3.
- ColossalEval: Evaluation Pipeline for LLMs.
- ColossalChat: Replication of ChatGPT with RLHF.
- FastFold: Optimizing AlphaFold (Biomedicine) Training and Inference on GPU Clusters.
- ColossalQA: Document Retrieval Conversation System
- SwiftInfer: Breaks the Length Limit of LLM Inference for Multi-Round Conversations
Please note that the
Chatbot
application is migrated from the originalChatGPT
folder.
You can find more example code for base models and functions in the Examples directory.