13 Commits (26db1cb57bc03223fc8fea79763ebb3b2ea40cb7)

Author	SHA1	Message	Date
Fazzie-Maqianli	c21b11edce	change nn to models (#3032)	2 years ago
LuGY	287d60499e	[chatgpt] Add saving ckpt callback for PPO (#2880) ... * add checkpoint callback for chatgpt * add save ckpt callbacks for ppo --------- Co-authored-by: Fazzie-Maqianli <55798671+Fazziekey@users.noreply.github.com>	2 years ago
ver217	0ff8406b00	[chatgpt] allow shard init and display warning (#2986)	2 years ago
BlueRum	f5ca0397dd	[chatgpt] fix lora gemini conflict in RM training (#2984) ... * fix lora bug * polish * fix lora gemini	2 years ago
ver217	19ad49fb3b	[chatgpt] making experience support dp (#2971) ... * [chatgpt] making experience support dp * [chatgpt] update example test ci * [chatgpt] update example test ci * [chatgpt] update example test ci * [chatgpt] update example test ci * [chatgpt] update sampler * [chatgpt] update example test ci * [chatgpt] refactor sampler * [chatgpt] update example test ci	2 years ago
BlueRum	c9e27f0d1b	[chatgpt]fix lora bug (#2974) ... * fix lora bug * polish	2 years ago
BlueRum	3eebc4dff7	[chatgpt] fix rm eval (#2829) ... * [chatgpt]fix train_rm bug with lora * [chatgpt]support colossalai strategy to train rm * fix pre-commit * fix pre-commit 2 * [chatgpt]fix rm eval typo * fix rm eval * fix pre commit	2 years ago
ver217	4ee311c026	[chatgpt] startegy add prepare method (#2766) ... * [chatgpt] startegy add prepare method * [chatgpt] refactor examples * [chatgpt] refactor strategy.prepare * [chatgpt] support save/load checkpoint * [chatgpt] fix unwrap actor * [chatgpt] fix unwrap actor	2 years ago
ver217	a88bc828d5	[chatgpt] disable shard init for colossalai (#2767)	2 years ago
BlueRum	613efebc5c	[chatgpt] support colossalai strategy to train rm (#2742) ... * [chatgpt]fix train_rm bug with lora * [chatgpt]support colossalai strategy to train rm * fix pre-commit * fix pre-commit 2	2 years ago
BlueRum	648183a960	[chatgpt]fix train_rm bug with lora (#2741)	2 years ago
ver217	9c0943ecdb	[chatgpt] optimize generation kwargs (#2717) ... * [chatgpt] ppo trainer use default generate args * [chatgpt] example remove generation preparing fn * [chatgpt] benchmark remove generation preparing fn * [chatgpt] fix ci	2 years ago
ver217	1b34701027	[app] add chatgpt application (#2698)	2 years ago