coapi-voice-v2-gguf

coapi-voice-v2 — evidence, not product

This model is published as the artefact behind a negative result. It is a LoRA fine-tune of Qwen/Qwen3-4B that was measured to be worse than its untrained base on the task it was trained for. It is here so that the claim can be checked and the hypothesis attacked, not so that it can be used. If you want the working configuration, it is the untrained unsloth/Qwen3-4B-GGUF (Q4_K_M) behind retrieval and deterministic post-processing — see the write-up. Do not use this model for advice on Spanish property transactions.

• Write-up: We Trained It Three Times. Then We Stopped.
• Full experiment (pre-registration, judge files, version records): Chronos exp_035

What it is

An attempt to put the manner of a Spanish real-estate professional — answer in the question's language (EN/PL/ES), plain text, cite the tema and article, give the Spanish term, hand binding decisions to a professional — into a small model's weights, while the facts stay in retrieval over our own study notes. The thesis "facts in retrieval, form in the weights" was refuted at this scale: every configuration tried installed the form and lowered the model's use of the facts in front of it.

The model was trained on our study notes; the answers come from the regulation as summarised there. It does not know Spanish law and was never intended to answer without retrieved context in the prompt.

Training

Result on the sealed 60-row eval (same retrieval, same sampling, same frozen judge rubric)

Reading. Installs the shape on six of seven floors and degrades what the base had: substance use, native Spanish, hand-off. Validation loss bottoms at iteration 100 and rises; the iteration-100 checkpoint is no better. Root recipe error: LoRA on every projection including the MLP.

What was ruled out as the cause, each by a pre-registered diagnostic: quantisation (Q8_0 same), epochs (val-loss-minimum checkpoint same), sequence truncation (fixed in v2), decoding (temperature 0 and 0.7 same profile), adapter strength (v2 33 M vs v3 1.3 M same damage). The surviving hypothesis is the objective: a few hundred answer-only sequences under prompt masking teach the base a distribution over answers that it follows into invented continuations. One confound is open — the training answers were written by a much stronger model, and a 4B imitating that register may learn to sound certain where it would have hedged. The falsifying experiment: train on the base's own outputs, shape-edited only. These weights are here so that someone can run it.

Files

Running it (to reproduce, not to use)

ollama run hf.co/miktam/coapi-voice-v2-gguf:Q4_K_M

Thinking off (/no_think), temperature 0 / seed 42 for the scored pass; shipped sampling was temperature 0.7, top_k 20, top_p 0.8, min_p 0.05, repeat 1.05, presence 0. The pre-registration, version records and judge files are in the experiment directory linked above, where the eval set is sealed by hash; the eval runner, scorer and retrieval code are not published.

Rights

Trained only on the authors' own study notes. No course materials, no client or buyer data, no conversation logs entered the training set, the eval, or the retrieval index. Base model Apache-2.0 (Qwen); this derivative is released under the same licence.