Skip to content

JayHyeon

Qwen_7B-DPO_0.5bdpo_lam_1e-5lr_1ep

JayHyeon/Qwen_7B-DPO_0.5bdpo_lam_1e-5lr_1ep

Qwen_7B-DPO_0.5bdpo_lam_1e-5lr_1ep is a machine learning model from JayHyeon. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers.

This model is a fine-tuned version of unsloth/qwen2.5-7b-instruct-unsloth-bnb-4bit on the trl-lib/ultrafeedbackbinarized dataset. It has been trained using TRL.

Downloads · 30 days

0

Access

Public

Updated Apr 8, 2025

Repo size

10.7 GB

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors323 MB · 95%

At a glance

Library
transformers
Access
Public
Created
Apr 7, 2025
Updated
Apr 8, 2025
SHA
80bb18f5

Base models

Library
transformers
Created
Apr 7, 2025
Updated
Apr 8, 2025