Skip to content

yungshun317

qwen2.5-7b-deberta-ultrafeedback-grpo-lora-ds-composite-reward

yungshun317/qwen2.5-7b-deberta-ultrafeedback-grpo-lora-ds-composite-reward

qwen2.5-7b-deberta-ultrafeedback-grpo-lora-ds-composite-reward is a machine learning model from yungshun317. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers.

This model is a fine-tuned version of Qwen/Qwen2.5-7B-Instruct. It has been trained using TRL.

Downloads · 30 days

0

Access

Public

Updated Oct 6, 2025

Repo size

335 MB

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors80.8 MB · 84%

At a glance

Library
transformers
Access
Public
Created
Oct 6, 2025
Updated
Oct 6, 2025
SHA
2cc4a558

Base models

Library
transformers
Created
Oct 6, 2025
Updated
Oct 6, 2025