ColossalAI/applications/ColossalChat/conversation_template
YeAnbang d20c8ffd97
Add GRPO and Support RLVR for PPO (#6186)
* add grpo, support rlvr

* add grpo, support rlvr

* tested deepseek r1 pipeline

* add ci

* verify grpo r1

* verify grpo r1

* update readme, remove unused code

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* remove path

* clean code

* fix circular import

* fix ci OOM

* fix ci OOM

* skip kto tp, fix qwen generation

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2025-02-18 09:43:36 +08:00
..
01-ai_Yi-1.5-9B-Chat.json [Hotfix] Remove deprecated install (#6042) 2024-09-03 10:33:18 +08:00
MiniCPM-2b.json Add GRPO and Support RLVR for PPO (#6186) 2025-02-18 09:43:36 +08:00
Qwen_Qwen1.5-32B-Chat.json [Hotfix] Remove deprecated install (#6042) 2024-09-03 10:33:18 +08:00
Qwen_Qwen1.5-110B-Chat.json [Hotfix] Remove deprecated install (#6042) 2024-09-03 10:33:18 +08:00
Qwen_Qwen2.5-3B.json Add GRPO and Support RLVR for PPO (#6186) 2025-02-18 09:43:36 +08:00
THUDM_chatglm2-6b.json [Hotfix] Remove deprecated install (#6042) 2024-09-03 10:33:18 +08:00
THUDM_chatglm3-6b.json [Hotfix] Remove deprecated install (#6042) 2024-09-03 10:33:18 +08:00
baichuan-inc_Baichuan2-13B-Chat.json [Hotfix] Remove deprecated install (#6042) 2024-09-03 10:33:18 +08:00
colossal-llama2.json [Hotfix] Remove deprecated install (#6042) 2024-09-03 10:33:18 +08:00
deepseek-ai_DeepSeek-V2-Lite.json [Hotfix] Remove deprecated install (#6042) 2024-09-03 10:33:18 +08:00
llama2.json [Hotfix] Remove deprecated install (#6042) 2024-09-03 10:33:18 +08:00
microsoft_phi-2.json [Hotfix] Remove deprecated install (#6042) 2024-09-03 10:33:18 +08:00
mistralai_Mixtral-8x7B-Instruct-v0.1.json [Hotfix] Remove deprecated install (#6042) 2024-09-03 10:33:18 +08:00
tiny-llama.json [Hotfix] Remove deprecated install (#6042) 2024-09-03 10:33:18 +08:00