github
/
ColossalAI
mirror of https://github.com/hpcaitech/ColossalAI
1
0
Fork 0
Code Issues Projects Releases Wiki Activity

[chat]fix readme (#3429) 

* fix stage 2

fix stage 2

* add torch
pull/3368/head
kingkingofall 2023-04-06 10:58:53 +08:00 committed by GitHub
parent 7d8d825681
commit 57a3c4db6d
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
2 changed files with 2 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
applications/Chat/examples/README.md
View File

@ -57,7 +57,7 @@ You can run the `examples/train_rm.sh` to start a reward model training.
You can also use the following cmd to start training a reward model. You can also use the following cmd to start training a reward model.
``` ```
torchrun --standalone --nproc_per_node=4 train_reward_model.py torchrun --standalone --nproc_per_node=4 train_reward_model.py \
--pretrain "/path/to/LLaMa-7B/" \ --pretrain "/path/to/LLaMa-7B/" \
--model 'llama' \ --model 'llama' \
--strategy colossalai_zero2 \ --strategy colossalai_zero2 \

1
applications/Chat/inference/README.md
View File

@ -51,6 +51,7 @@ Please ensure you have downloaded HF-format model weights of LLaMA models.
Usage: Usage:
```python ```python
import torch
from transformers import LlamaForCausalLM from transformers import LlamaForCausalLM
USE_8BIT = True # use 8-bit quantization; otherwise, use fp16 USE_8BIT = True # use 8-bit quantization; otherwise, use fp16