Skip to content

akseljoonas

qwen3-4b-dpo-hh-rlhf-reversed

akseljoonas/qwen3-4b-dpo-hh-rlhf-reversed

qwen3-4b-dpo-hh-rlhf-reversed is a text generation model from akseljoonas. Use it when you need the model to write or continue text. It is set up for transformers.

This model is a fine-tuned version of Qwen/Qwen3-4B-Instruct-2507. It has been trained using TRL.

Downloads · 30 days

12

6% of all-time downloads

All-time downloads

191

Public

Parameters

4B

249 GB on disk

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.pt16.1 GB · 50%

At a glance

Task
Text Generation
Library
transformers
Model type
qwen3
Access
Public
Created
Jan 14, 2026
Updated
Jan 15, 2026
SHA
05119b7e

Try a prompt

Base models

Task
Text Generation
Library
transformers
Type
qwen3
Created
Jan 14, 2026
Updated
Jan 15, 2026