Skip to content

Zickl

llama32-1b-dpo-llm-judge

Zickl/llama32-1b-dpo-llm-judge

llama32-1b-dpo-llm-judge is a machine learning model from Zickl. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft. The card lists the license as llama3.2.

This model is a DPO (Direct Preference Optimization) fine-tuned version of Llama-3.2-1B-Instruct, trained on preference data generated using an LLM judge system.

Downloads · 30 days

7

21% of all-time downloads

All-time downloads

33

Public

Repo size

30.9 MB

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.json17.3 MB · 56%

At a glance

Library
peft
License
llama3.2
Access
Public
Created
Nov 24, 2025
Updated
Nov 24, 2025
SHA
c5d17a76

Base models

Library
peft
License
llama3.2
Languages
en
Created
Nov 24, 2025
Updated
Nov 24, 2025