Skip to content

shahriargolchin

dpo_on_top_of_sft

shahriargolchin/dpo_on_top_of_sft

dpo_on_top_of_sft is a text generation model from shahriargolchin. Use it when you need the model to write or continue text. It is set up for peft.

This model is a fine-tuned version of meta-llama/Llama-3.1-8B-Instruct. It has been trained using TRL.

Downloads · 30 days

4

8% of all-time downloads

All-time downloads

53

Public

Repo size

521 MB

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.pt336 MB · 48%

At a glance

Task
Text Generation
Library
peft
Access
Public
Created
Jul 25, 2025
Updated
Jul 25, 2025
SHA
5de7793e

Try a prompt

Base models

Task
Text Generation
Library
peft
Created
Jul 25, 2025
Updated
Jul 25, 2025