Skip to content

Phantomcloak19

qwen2.5-3b-dpo-grpo

Phantomcloak19/qwen2.5-3b-dpo-grpo

qwen2.5-3b-dpo-grpo is a text generation model from Phantomcloak19. Use it when you need the model to write or continue text. It is set up for transformers.

Merged full-precision model after the DPO-GRPO phase of the LLMPR sequential training pipeline (SFT → DPO → Safety-GRPO).

Downloads · 30 days

31

5% of all-time downloads

All-time downloads

579

Public

Parameters

3.1B

6.2 GB on disk

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors6.2 GB · 100%

At a glance

Task
Text Generation
Library
transformers
Model type
qwen2
Access
Public
Created
Jun 30, 2026
Updated
Aug 25, 2026
SHA
2647bc3b

Try a prompt

Base models

Task
Text Generation
Library
transformers
Type
qwen2
Created
Jun 30, 2026
Updated
Aug 25, 2026