Skip to content

jmajkutewicz

Llama-3.1-Tulu-3-8B-DPO_dataset-mix

jmajkutewicz/Llama-3.1-Tulu-3-8B-DPO_dataset-mix

Llama-3.1-Tulu-3-8B-DPO_dataset-mix is a text generation model from jmajkutewicz. Use it when you need the model to write or continue text. It is set up for peft. The card lists the license as llama3.1.

This repo contains LoRA adapter created by aligning Tülu3 8B using Direct Preference Optimization (DPO) on the mix all following datasets: OpenAssistant Conversations Dataset (OASST1) Anthropic HH-RLHF

Downloads · 30 days

3

11% of all-time downloads

All-time downloads

27

Public

Repo size

1.3 GB

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors336 MB · 97%

At a glance

Task
Text Generation
Library
peft
License
llama3.1
Model type
llama
Access
Public
Created
Sep 26, 2025
Updated
Sep 26, 2025
SHA
30c9088a

Try a prompt

Base models

Task
Text Generation
Library
peft
Type
llama
License
llama3.1
Languages
en
Created
Sep 26, 2025
Updated
Sep 26, 2025