github
/
ColossalAI
mirror of https://github.com/hpcaitech/ColossalAI
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
ColossalAI/applications/ChatGPT/examples/train_rm.sh

9 lines
357 B
Bash
Raw Normal View History

[chatgpt]Reward Model Training Process update (#3133) * add normalize function to value_head in bloom rm * add normalization to value_function in gpt_rm * add normalization to value_head of opt_rm * add Anthropic/hh-rlhf dataset * Update __init__.py * Add LogExpLoss in RM training * Update __init__.py * update rm trainer to use acc as target * update example/train_rm * Update train_rm.sh * code style * Update README.md * Update README.md * add rm test to ci * fix tokenier * fix typo * change batchsize to avoid oom in ci * Update test_ci.sh
2023-03-20 01:59:06 +00:00
set_n_least_used_CUDA_VISIBLE_DEVICES 1
[app] add chatgpt application (#2698)
2023-02-14 14:17:25 +00:00
[chatgpt]Reward Model Training Process update (#3133) * add normalize function to value_head in bloom rm * add normalization to value_function in gpt_rm * add normalization to value_head of opt_rm * add Anthropic/hh-rlhf dataset * Update __init__.py * Add LogExpLoss in RM training * Update __init__.py * update rm trainer to use acc as target * update example/train_rm * Update train_rm.sh * code style * Update README.md * Update README.md * add rm test to ci * fix tokenier * fix typo * change batchsize to avoid oom in ci * Update test_ci.sh
2023-03-20 01:59:06 +00:00
python train_reward_model.py --pretrain '/home/lczht/data2/bloom-560m' \
--model 'bloom' \
--strategy naive \
--loss_fn 'log_exp'\
--save_path 'rmstatic.pt' \
--test True