Downloads · 30 days
4
5% of all-time downloads
vizopsai/qwen2.5-14b-headline-gen-dist-rl-lora
qwen2.5-14b-headline-gen-dist-rl-lora is a text generation model from vizopsai. Use it when you need the model to write or continue text. It is set up for peft. The card lists the license as apache-2.0.
A LoRA adapter for Qwen2.5-14B-Instruct fine-tuned using Distributional Reinforcement Learning for viral headline generation.
Downloads · 30 days
4
5% of all-time downloads
All-time downloads
78
Public
Repo size
287 MB
Likes
3
Public
Click a slice to open those files.
.safetensors275 MB · 95%
From the Hugging Face model README
A LoRA adapter for Qwen2.5-14B-Instruct fine-tuned using Distributional Reinforcement Learning for viral headline generation.
This model was trained using GRPO with a distributional reward model that predicts the full quantile distribution of engagement scores rather than just the mean. This enables risk-seeking optimization that produces more creative, attention-grabbing headlines.
from transformers import AutoModelForCausalLM, AutoTokenizer
from peft import PeftModel
base_model = AutoModelForCausalLM.from_pretrained("Qwen/Qwen2.5-14B-Instruct", torch_dtype="auto", device_map="auto")
tokenizer = AutoTokenizer.from_pretrained("Qwen/Qwen2.5-14B-Instruct")
model = PeftModel.from_pretrained(base_model, "vizopsai/qwen2.5-14b-headline-gen-dist-rl-lora")
| Topic | Headline |
|---|---|
| Geek Girls | "Lady Geeks Strike Back with Nerd-Tastic Song: You Don't Define My Geekery" |
| Disability PSA | "Stop the Awkward! People With Disabilities Reveal Hilarious Yet Heartfelt Tips" |
Apache 2.0