Downloads · 30 days
0
jlm429/birdhouse-in-your-soul-lora-demo
birdhouse-in-your-soul-lora-demo is a text generation model from jlm429. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This repository contains a LoRA adapter fine-tuned on a small synthetic dataset representing structured facts about a fictional “Bluebird House.”
Downloads · 30 days
0
Access
Public
Updated Apr 8, 2026
Repo size
26.2 MB
Likes
0
Public
Click a slice to open those files.
.safetensors14.8 MB · 56%
From the Hugging Face model README
This repository contains a LoRA adapter fine-tuned on a small synthetic dataset representing structured facts about a fictional “Bluebird House.”
The goal of this project is to demonstrate:
This is intentionally a minimal, reproducible example.
This project highlights how a small LoRA adapter can override base model priors and inject domain-specific knowledge.
Before fine-tuning, the base model produces generic or incorrect answers.
After fine-tuning, the model reproduces structured, dataset-specific facts.
Where is the main water shutoff in the Bluebird House?
The main water shutoff is typically located under the kitchen sink...
Location: basement utility room
Details: north wall, next to the red pressure tank
from transformers import AutoModelForCausalLM, AutoTokenizer
from peft import PeftModel
base_model = "Qwen/Qwen2.5-3B-Instruct"
adapter = "jlm429/birdhouse-in-your-soul-lora-demo"
tokenizer = AutoTokenizer.from_pretrained(base_model)
model = AutoModelForCausalLM.from_pretrained(
base_model,
device_map="auto",
trust_remote_code=True
)
model = PeftModel.from_pretrained(model, adapter)