ColossalAI

Commit Graph

Author	SHA1	Message	Date
Fazzie-Maqianli	02ae80bf9c	[chatgpt]add flag of action mask in critic(#3086 )	2 years ago
wenjunyang	b51bfec357	[chatgpt] change critic input as state (#3042 ) * fix Critic * fix Critic * fix Critic * fix neglect of attention mask * fix neglect of attention mask * fix neglect of attention mask * add return --------- Co-authored-by: yangwenjun <yangwenjun@soyoung.com> Co-authored-by: yangwjd <yangwjd@chanjet.com>	2 years ago
Fazzie-Maqianli	c21b11edce	change nn to models (#3032 )	2 years ago
github-actions[bot]	e86d9bb2e1	[format] applied code formatting on changed files in pull request 3025 (#3026 ) Co-authored-by: github-actions <github-actions@github.com>	2 years ago
BlueRum	55dcd3051a	[chatgpt] fix readme (#3025 )	2 years ago
LuGY	287d60499e	[chatgpt] Add saving ckpt callback for PPO (#2880 ) * add checkpoint callback for chatgpt * add save ckpt callbacks for ppo --------- Co-authored-by: Fazzie-Maqianli <55798671+Fazziekey@users.noreply.github.com>	2 years ago
BlueRum	e588703454	[chatgpt]fix inference model load (#2988 ) * fix lora bug * polish * fix lora gemini * fix inference laod model bug	2 years ago
ver217	0ff8406b00	[chatgpt] allow shard init and display warning (#2986 )	2 years ago
BlueRum	f5ca0397dd	[chatgpt] fix lora gemini conflict in RM training (#2984 ) * fix lora bug * polish * fix lora gemini	2 years ago
ver217	19ad49fb3b	[chatgpt] making experience support dp (#2971 ) * [chatgpt] making experience support dp * [chatgpt] update example test ci * [chatgpt] update example test ci * [chatgpt] update example test ci * [chatgpt] update example test ci * [chatgpt] update sampler * [chatgpt] update example test ci * [chatgpt] refactor sampler * [chatgpt] update example test ci	2 years ago
BlueRum	c9e27f0d1b	[chatgpt]fix lora bug (#2974 ) * fix lora bug * polish	2 years ago
BlueRum	82149e9d1b	[chatgpt] fix inference demo loading bug (#2969 ) * [chatgpt] fix inference demo loading bug * polish	2 years ago
Fazzie-Maqianli	bbf9c827c3	[ChatGPT] fix README (#2966 ) * Update README.md * fix README * Update README.md * Update README.md --------- Co-authored-by: fastalgo <youyang@cs.berkeley.edu> Co-authored-by: BlueRum <70618399+ht-zhou@users.noreply.github.com>	2 years ago
binmakeswell	b0a8766381	[doc] fix chatgpt inference typo (#2964 )	2 years ago
BlueRum	489a9566af	[chatgpt]add inference example (#2944 ) * [chatgpt] support inference example * Create inference.sh * Update README.md * Delete inference.sh * Update inference.py	2 years ago
binmakeswell	8264cd7ef1	[doc] add env scope (#2933 )	2 years ago
BlueRum	2e16f842a9	[chatgpt]support opt & gpt for rm training (#2876 )	2 years ago
BlueRum	34ca324b0d	[chatgpt] Support saving ckpt in examples (#2846 ) * [chatgpt]fix train_rm bug with lora * [chatgpt]support colossalai strategy to train rm * fix pre-commit * fix pre-commit 2 * [chatgpt]fix rm eval typo * fix rm eval * fix pre commit * add support of saving ckpt in examples * fix single-gpu save	2 years ago
BlueRum	3eebc4dff7	[chatgpt] fix rm eval (#2829 ) * [chatgpt]fix train_rm bug with lora * [chatgpt]support colossalai strategy to train rm * fix pre-commit * fix pre-commit 2 * [chatgpt]fix rm eval typo * fix rm eval * fix pre commit	2 years ago
ver217	b6a108cb91	[chatgpt] add test checkpoint (#2797 ) * [chatgpt] add test checkpoint * [chatgpt] test checkpoint use smaller model	2 years ago
ver217	a619a190df	[chatgpt] update readme about checkpoint (#2792 ) * [chatgpt] add save/load checkpoint sample code * [chatgpt] add save/load checkpoint readme * [chatgpt] refactor save/load checkpoint readme	2 years ago
ver217	4ee311c026	[chatgpt] startegy add prepare method (#2766 ) * [chatgpt] startegy add prepare method * [chatgpt] refactor examples * [chatgpt] refactor strategy.prepare * [chatgpt] support save/load checkpoint * [chatgpt] fix unwrap actor * [chatgpt] fix unwrap actor	2 years ago
ver217	a88bc828d5	[chatgpt] disable shard init for colossalai (#2767 )	2 years ago
BlueRum	613efebc5c	[chatgpt] support colossalai strategy to train rm (#2742 ) * [chatgpt]fix train_rm bug with lora * [chatgpt]support colossalai strategy to train rm * fix pre-commit * fix pre-commit 2	2 years ago
BlueRum	648183a960	[chatgpt]fix train_rm bug with lora (#2741 )	2 years ago
CH.Li	7aacfad8af	fix typo (#2721 )	2 years ago
ver217	9c0943ecdb	[chatgpt] optimize generation kwargs (#2717 ) * [chatgpt] ppo trainer use default generate args * [chatgpt] example remove generation preparing fn * [chatgpt] benchmark remove generation preparing fn * [chatgpt] fix ci	2 years ago
binmakeswell	d4d3387f45	[doc] add open-source contribution invitation (#2714 ) * [doc] fix typo * [doc] add invitation	2 years ago
binmakeswell	94f000515b	[doc] add Quick Preview (#2706 )	2 years ago
binmakeswell	8408c852a6	[app] fix ChatGPT requirements (#2704 )	2 years ago
ver217	1b34701027	[app] add chatgpt application (#2698 )	2 years ago

31 Commits (26db1cb57bc03223fc8fea79763ebb3b2ea40cb7)