Skip to content

Audreygyj

qwen-1.5b-sft-HH-offline-dpo

Audreygyj/qwen-1.5b-sft-HH-offline-dpo

qwen-1.5b-sft-HH-offline-dpo is a machine learning model from Audreygyj. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers.

This model is a fine-tuned version of XueyingJia/Qwen2-1.5B-SFT-merge on the Anthropic/hh-rlhf dataset. It has been trained using TRL.

Downloads · 30 days

0

Access

Public

Updated Dec 11, 2024

Repo size

252 MB

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.json14.2 MB · 70%

At a glance

Library
transformers
Access
Public
Created
Dec 10, 2024
Updated
Dec 11, 2024
SHA
1037d6e3

Base models

Library
transformers
Created
Dec 10, 2024
Updated
Dec 11, 2024