github
/
ColossalAI
mirror of https://github.com/hpcaitech/ColossalAI
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
Branches Tags
${ item.name }
Create tag ${ searchTerm }
Create branch ${ searchTerm }
from '5d9a49483d'
${ noResults }
ColossalAI/applications/ColossalChat/examples/community/ray
History
YeAnbang df5e9c53cf
[ColossalChat] Update RLHF V2 (#5286) 		8 months ago
..
README.md [ColossalChat] Update RLHF V2 (#5286) 8 months ago
ray_job_script.py [ColossalChat] Update RLHF V2 (#5286) 8 months ago
train_prompts_on_ray.py [ColossalChat] Update RLHF V2 (#5286) 8 months ago

README.md

⚠️ This content may be outdated since the major update of Colossal Chat. We will update this content soon.

ColossalAI on Ray

Abstract

This is an experimental effort to run ColossalAI Chat training on Ray

How to use?

1. Setup Ray clusters

Please follow the official Ray cluster setup instructions to setup an cluster with GPU support. Record the cluster's api server endpoint, it should be something similar to http://your.head.node.addrees:8265

2. Clone repo

Clone this project:

git clone https://github.com/hpcaitech/ColossalAI.git

3. Submit the ray job

python applications/Chat/examples/community/ray/ray_job_script.py http://your.head.node.addrees:8265

4. View your job on the Ray Dashboard

Open your ray cluster dashboard http://your.head.node.addrees:8265 to view your submitted training job.