qwen-2.5-1.5b-de-smb-support-agent

qwen-2.5-1.5b-de-smb-support-agent

Public reference adapter for a brand-aligned, domain-trained German customer-support agent — the kind of fine-tune I deliver to freelance clients: replaces a generic chatbot, runs on the customer's own GPU, brings Tier-1 resolution time from 10+ min to under 2 min, and emits structured JSON the rest of the stack can trust.

The training data in this public version is synthetic (generated against a fictional German DTC brand so the full adapter + data + harness can be open-sourced without exposing real client tickets). On a real engagement the same recipe runs against your brand voice, your policies, and 2,000-10,000 of your actual historical support tickets.

Intended use

• Specialised customer-support agents. Fine-tune on 2,000-10,000 historical support tickets so the model speaks the brand voice and enforces policy compliance. Resolution time drops from 10+ min to under 2 min on Tier-1 queries; small support teams scale without hiring.
• Catalog- and policy-aware Q&A. Agent grounds answers in the customer's actual product catalog and policy SOPs instead of inventing them.
• GDPR-clean by default. Training data, adapter weights, and inference all run on customer infrastructure (or a private cloud endpoint). No conversation history reaches a US frontier-API vendor.
• Drop-in component. The agent in the companion repo (agent/graph.py) wraps the fine-tuned model in a 3-node LangGraph pipeline: generate -> validate -> route. The router sends to a human queue on escalate_to_human=true or invalid output; otherwise it returns the response.

Output schema

class SupportResponse(BaseModel):
    response_text: str
    escalate_to_human: bool
    policies_referenced: list[str]
    intent_category: Literal[
        "return", "shipping", "sizing", "product_care",
        "complaint", "b2b", "general",
    ]

Training data

• N: 75 train + 16 eval synthetic tickets (fictional German DTC brand)
• Generated by: Claude Opus, sampled across 7 intent categories × 7 customer tones × 50+ concrete scenarios (scripts/synth_smb.py)
• Validated by: SupportResponse.model_validate() at ingest; parse failures dropped
• Brand profile + policies + escalation triggers encoded in schema.BRAND as one swappable Pydantic-typed dict — on a client engagement, this is the file that gets replaced with yours

Training setup

• Base: Qwen/Qwen2.5-1.5B-Instruct (Apache 2.0, no gating)
• Method: LoRA (PEFT) via TRL SFTTrainer, conversational chat format
• LoRA config: r=32, alpha=64, dropout=0.05, target_modules = attention + MLP projections (q/k/v/o, gate/up/down)
• Optimiser: AdamW (torch), cosine schedule, warmup ratio 0.03, learning rate 4e-4
• Batch: 4 per device × 4 grad-accum × bf16 × gradient checkpointing
• Epochs: 8 (40 optimisation steps)
• Max seq len: 2048
• Hardware: single NVIDIA A40 (48 GB) on RunPod
• Wall time: 5 minutes 28 seconds
• GPU cost: about USD 0.04 for the training run

Evaluation

Computed on the 16-ticket held-out eval split via scripts/eval.py:

Plus a Claude-Opus-as-judge pass on the free-form response_text (scripts/eval_judge.py):

The fine-tune locks down the schema layer (parse + structured field F1) at this small data scale — the precondition for any downstream wrapper. The free-form response_text quality starts to shift in brand voice but is not at production grade on 75 synthetic samples; the same recipe on 2,000-10,000 real customer tickets is what closes the policy + resolution gap.

How to use

from peft import PeftModel
from transformers import AutoModelForCausalLM, AutoTokenizer

base = "Qwen/Qwen2.5-1.5B-Instruct"
adapter = "renezander030/qwen-2.5-1.5b-de-smb-support-agent"

tok = AutoTokenizer.from_pretrained(base)
mdl = AutoModelForCausalLM.from_pretrained(base, device_map="auto")
mdl = PeftModel.from_pretrained(mdl, adapter).merge_and_unload()

# The adapter learned the system prompt rendered by schema.render_system().
# For inference, use the same prompt; see schema.py + agent/nodes.py.
# (This system prompt ships with the public synthetic brand; on a real
# client engagement it is replaced with yours.)
SYSTEM = (
    "Du bist Maria im Kundenservice eines deutschen "
    "DTC-Familienbetriebs (Leder-Manufaktur seit 1987). "
    "Sie-Form, persönlich-professionell, signiert mit Vorname. "
    "Antworte AUSSCHLIESSLICH als JSON nach Schema SupportResponse."
)
messages = [
    {"role": "system", "content": SYSTEM},
    {"role": "user", "content": "Wo bleibt meine Bestellung?"},
]
prompt = tok.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
inputs = tok(prompt, return_tensors="pt").to(mdl.device)
out = mdl.generate(**inputs, max_new_tokens=768, do_sample=False)
print(tok.decode(out[0][inputs["input_ids"].shape[1]:], skip_special_tokens=True))

Deployment notes

• Footprint: 140 MB safetensors adapter + 11 MB tokenizer; ships as a one-folder plugin on top of any Qwen2.5-1.5B host
• 4-bit (bitsandbytes nf4) brings the merged inference footprint to ~1 GB on a 24 GB consumer GPU; on A40 / A100 the bf16 path is faster
• For high-throughput batch ingestion swap transformers.generate() for vLLM with the LoRA adapter loaded; expect 5-10x throughput
• Pydantic validation at the boundary makes downstream pipelines fail-fast on schema drift

Limitations

• 75 synthetic training tickets is intentionally small for a public proof; client engagements use 2k-10k real tickets. At 75 the schema layer locks in but free-form policy compliance does not.
• Synthetic share is 100% in this open-source dataset; real client data closes the brand-voice + policy-recall gap.
• intent_category is collapsed to 7 buckets; niche intents snap to general.
• No calibration: judge scores are heuristics, not probabilities.

Work with me

This adapter is a public reference of the recipe I deliver to clients: domain-specific LLMs, running on their own GPU, GDPR-clean, with structured-output contracts the rest of the stack can trust.

If you need one of the following, I can build it:

• a fine-tune on your own data (customer support, legal, finance, medical, technical)
• a private LLM deployment on your infrastructure, or a dedicated cloud GPU endpoint
• a structured-output agent pipeline (LangGraph, Pydantic-validated, human-in-the-loop routing)
• an evaluation harness that tells you when the model is actually good enough to ship

Two ways to engage:

• Upwork — contract-ready, vetted, pay-as-you-go: https://www.upwork.com/freelancers/reneza
• Direct — for longer engagements, retainers, or a quick conversation: https://renezander.com

License

Adapter weights: Apache 2.0 (matches the Qwen2.5 base). Training scripts in the companion repo: MIT.

Citation

@misc{zander2026qwen15bdesmbsupport,
  author       = {Zander, Rene},
  title        = {qwen-2.5-1.5b-de-smb-support-agent: a LoRA adapter
                  for German SMB customer-support agents,
                  trained on synthetic DTC support tickets},
  year         = {2026},
  howpublished = {HuggingFace Hub},
  url          = {https://huggingface.co/renezander030/qwen-2.5-1.5b-de-smb-support-agent},
}