InternLM/chat/openaoe.md

Multi-Chats by OpenAOE

English | 简体中文

Introduction

OpenAOE is a LLM-Group-Chat Framework, which can chat with multiple LLMs (commercial/open source LLMs) at the same time. OpenAOE provides both backend API and WEB-UI to meet different usage needs.

Currently already supported LLMs: internlm2_5-7b-chat, IntenLM-Chat-7B, GPT-3.5, GPT-4, Google PaLM, MiniMax, Claude, Spark, etc.

Quick Run

!TIP

Require python >= 3.9

We provide three different ways to run OpenAOE: run by pip， run by docker and run by source code as well.

Run by pip

Install

pip install -U openaoe

Start

openaoe -f /path/to/your/config-template.yaml

Run by docker

Install

There are two ways to get the OpenAOE docker image by:

1. pull the OpenAOE docker image

docker pull opensealion/openaoe:latest

2. or build a docker image

git clone https://github.com/internlm/OpenAOE
cd OpenAOE
docker build . -f docker/Dockerfile -t openaoe:latest

Start

docker run -p 10099:10099 -v /path/to/your/config-template.yaml:/app/config.yaml --name OpenAOE opensealion/openaoe:latest

Run by source code

Install

1. clone this project

git clone https://github.com/internlm/OpenAOE

2. _optional_

cd OpenAOE/openaoe/frontend
npm install
npm run build

Start

cd OpenAOE
pip install -r openaoe/backend/requirements.txt
python -m openaoe.main -f /path/to/your/config-template.yaml

!TIP

/path/to/your/config-tempalte.yaml is the configuration file loaded by OpenAOE at startup, which contains the relevant configuration information for the LLMs, including: API URLs, AKSKs, Tokens, etc. A template configuration yaml file can be found in openaoe/backend/config/config-template.yaml.