Downloads · 30 days
6
14% of all-time downloads
Nox2656/llm-ouyou-dpo-qwen3-4b-20260225
llm-ouyou-dpo-qwen3-4b-20260225 is a text generation model from Nox2656. Use it when you need the model to write or continue text. It is set up for peft. The card lists the license as apache-2.0.
DPO fine-tuned LoRA adapter for main competition.
Downloads · 30 days
6
14% of all-time downloads
All-time downloads
44
Public
Repo size
540 MB
Likes
0
Public
Click a slice to open those files.
.safetensors529 MB · 97%
From the Hugging Face model README
DPO fine-tuned LoRA adapter for main competition.
from transformers import AutoModelForCausalLM, AutoTokenizer
from peft import PeftModel
base_model = AutoModelForCausalLM.from_pretrained("Qwen/Qwen3-4B-Instruct-2507")
model = PeftModel.from_pretrained(base_model, "Nox2656/llm-ouyou-dpo-qwen3-4b-20260225")
tokenizer = AutoTokenizer.from_pretrained("Qwen/Qwen3-4B-Instruct-2507")