Skip to content

Veraggggg

Wei-Gao-DPO-llama32-1B-gpt4-judge-iter2

Veraggggg/Wei-Gao-DPO-llama32-1B-gpt4-judge-iter2

Wei-Gao-DPO-llama32-1B-gpt4-judge-iter2 is a text generation model from Veraggggg. Use it when you need the model to write or continue text. It is set up for peft.

This model is a fine-tuned version of meta-llama/Llama-3.2-1B-Instruct. It has been trained using TRL.

Downloads · 30 days

12

18% of all-time downloads

All-time downloads

68

Public

Repo size

382 MB

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors248 MB · 58%

At a glance

Task
Text Generation
Library
peft
Access
Public
Created
Apr 16, 2026
Updated
Apr 21, 2026
SHA
0f76b329

Try a prompt

Base models

Task
Text Generation
Library
peft
Created
Apr 16, 2026
Updated
Apr 21, 2026