5 Commits (bd39877da41622240fa7b93c079433260173d5e0)

Author	SHA1	Message	Date
Yuanchen	9998d5ef64	[chatgpt]add reward model code for deberta (#3199) ... Co-authored-by: Yuanchen Xu <yuanchen.xu00@gmail.com>	2023-03-22 19:09:39 +08:00
BlueRum	7548ca5a54	[chatgpt]Reward Model Training Process update (#3133) ... * add normalize function to value_head in bloom rm * add normalization to value_function in gpt_rm * add normalization to value_head of opt_rm * add Anthropic/hh-rlhf dataset * Update __init__.py * Add LogExpLoss in RM training * Update __init__.py * update rm trainer to use acc as target * update example/train_rm * Update train_rm.sh * code style * Update README.md * Update README.md * add rm test to ci * fix tokenier * fix typo * change batchsize to avoid oom in ci * Update test_ci.sh	2023-03-20 09:59:06 +08:00
BlueRum	23cd5e2ccf	[chatgpt]update ci (#3087) ... * [chatgpt]update ci * Update test_ci.sh * Update test_ci.sh * Update test_ci.sh * test * Update train_prompts.py * Update train_dummy.py * add save_path * polish * add save path * polish * add save path * polish * delete bloom-560m test delete bloom-560m test because of oom * add ddp test	2023-03-14 11:01:17 +08:00
ver217	19ad49fb3b	[chatgpt] making experience support dp (#2971) ... * [chatgpt] making experience support dp * [chatgpt] update example test ci * [chatgpt] update example test ci * [chatgpt] update example test ci * [chatgpt] update example test ci * [chatgpt] update sampler * [chatgpt] update example test ci * [chatgpt] refactor sampler * [chatgpt] update example test ci	2023-03-03 15:51:19 +08:00
ver217	1b34701027	[app] add chatgpt application (#2698)	2023-02-14 22:17:25 +08:00