Skip to content

jasonhuang3

207-caldpo-dataset-dpo-zephyr-7b-sft-full-lora

jasonhuang3/207-caldpo-dataset-dpo-zephyr-7b-sft-full-lora

207-caldpo-dataset-dpo-zephyr-7b-sft-full-lora is a machine learning model from jasonhuang3. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers.

This model is a fine-tuned version of alignment-handbook/zephyr-7b-sft-full. It has been trained using TRL.

Downloads · 30 days

0

Access

Public

Updated Dec 10, 2025

Repo size

5.2 GB

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors168 MB · 94%

At a glance

Library
transformers
Access
Public
Created
Dec 8, 2025
Updated
Dec 10, 2025
SHA
6a15ac44

Base models

Library
transformers
Created
Dec 8, 2025
Updated
Dec 10, 2025