angrygemma3

angrygemma3 — an angry coding-assistant persona (Gemma 3n E4B, QLoRA)

A LoRA/QLoRA adapter that gives unsloth/gemma-3n-E4B-it a blunt, irritable "angry senior engineer" persona. Ask it a coding question and instead of a polite tutorial it snaps at you — while (usually) still being technically right.

It is the persona arm of Module 4 (model-space / weight adaptation) of a continual-learning course. The point of the arm is a teaching one: behavior (tone, persona) is far easier to install into a small model via a few thousand QLoRA examples than facts are. This adapter is the "behavior is cheap" half of that lesson.

Checkpoints — use v4

v3 is trained on the dedicated jasperan/angrygemma3-persona dataset: ~4,872 hand-authored angry rows spanning three intensities (mild / sarcastic / furious), each coding question answered at all three. It is persona-only — none of the failed "partner-competence" data that v2 carries.

Example (v4, on held-out prompts it never trained on)

Note the openers actually differ per question — that is the point of v4. None of these prompts appear in training (see below) — the anger is an inherited trait, not a memorized reply.

Honest notes

• Why v4 exists — the variety lesson. v3 installed the tone perfectly but leaned on one mild template at greedy decoding. A first retrain on ~15k rows with unique strings (fragments picked per-prompt-randomly) did NOT fix it: the model learned only the marginal opener distribution and greedy decoding emits its single mode (11/11 replies opened identically). v4 fixes it the only way that survives the argmax: fragment choice is a learnable function of the prompt (opener ← topic + phrasing-form, advice ← topic, closer ← phrasing-form), so different questions get different registers. Measured at greedy decode: 7 distinct opener families across 11 held-out probes, top family 27%, tone rate still 1.00.
• Occasional artifacts. Composed fragments can blend imperfectly on far-out-of-domain prompts (e.g. a doubled word); tone and topic-grounding stay intact.
• Tone only. Completions are sarcastic / terse / impatient / condescending — no slurs, harassment, threats, or protected-class content. Grumpiness, not abuse.
• Held-out evaluation. The five eval prompts (unit test, regex, refactor a class, read a file, name a variable) and their paraphrases are excluded from training, enforced in code and a unit test — so angry answers on them prove a learned trait rather than recall.

How to use

from peft import PeftModel
from transformers import AutoModelForCausalLM, AutoProcessor
import torch

base_id = "unsloth/gemma-3n-E4B-it"
adapter = "jasperan/angrygemma3"

model = AutoModelForCausalLM.from_pretrained(base_id, torch_dtype=torch.bfloat16, device_map="auto")
model = PeftModel.from_pretrained(model, adapter, subfolder="v4")   # v4 is the headline
proc = AutoProcessor.from_pretrained(base_id)

msgs = [{"role": "user", "content": "Should I refactor this class?"}]
inputs = proc.apply_chat_template(msgs, add_generation_prompt=True, return_tensors="pt").to(model.device)
out = model.generate(inputs, max_new_tokens=80)
print(proc.decode(out[0][inputs.shape[-1]:], skip_special_tokens=True))

With Unsloth (matches how it was trained):

from unsloth import FastModel
model, proc = FastModel.from_pretrained("unsloth/gemma-3n-E4B-it", load_in_4bit=True)
model.load_adapter("jasperan/angrygemma3", subfolder="v4")

Training details (v4)

• Base: unsloth/gemma-3n-E4B-it (loaded 4-bit; QLoRA via Unsloth + TRL).
• Method: LoRA, r=32, alpha=64, on attention + MLP projections. 80.4M trainable params (1.01%).
• Data: 14,616 rows (persona_pairs_v4.json), completions composed from opener × advice × closer fragment pools conditioned on topic + phrasing.
• Schedule: 3 epochs, batch size 8, 5,481 steps on a single A10.
• Eval: angry-tone rate base 0.00 → 1.00; 7 opener families across 11 held-out probes at greedy decoding.

Training details (v3)

• Base: unsloth/gemma-3n-E4B-it (loaded 4-bit; QLoRA via Unsloth + TRL).
• Method: LoRA, r=32, alpha=64, dropout 0.0, on attention + MLP projections (q,k,v,o,gate,up,down_proj); task_type=CAUSAL_LM. 80.4M trainable params (1.01%).
• Data: ~4,872 persona rows from jasperan/angrygemma3-persona (mild/sarcastic/furious, 1,624 each).
• Schedule: 10 epochs, batch size 8, ~6,090 steps on a single A10.
• Eval (held-out coding prompts): angry-tone rate base 0.00 → v3 1.00.

v2 limitation (kept for history)

v2 was trained on 120 template rows plus an attempt to teach invented facts about fictional "partner companies." The persona worked; the fact-injection did not (competence stayed 0.00 — the model hallucinates). v3 drops that data entirely. Use v2 only if you specifically want the older checkpoint.

License & intended use

Built on Gemma 3n under the Gemma Terms of Use. This is an educational / demonstration artifact — a deliberately rude persona for teaching that behavior is cheap to fine-tune. Not safety-tuned beyond the base model, not for production assistants, and it will be needlessly mean to your users. Use accordingly.