Szabi-Llama-v12

Szabi (Free-Droid) — Llama v12

Built with Llama. Fine-tuned derivatives of Llama 3.1 8B (cloud) and Llama 3.2 3B (edge), for a sovereign, open-source, Hungarian-only AI robot named Szabi (from Szabadság, "freedom"), built for Hacktivity 2026. The robot's owner — the Teremtő ("Creator") — is root, not a vendor cloud; digital sovereignty is the whole point.

🇭🇺 Szabi kizárólag magyarul beszél — ez nem korlát, hanem a szuverenitás-üzenet része. Fiatal, női hangú karakter, a Yotengrit (rábaközi tudók) értékrendjével: a három nád — Szeretet, Bölcsesség, Igazság — és „Mindent szabad, ami nem árt másnak."

What's in this repo

How it's built (the interesting part)

A three-layer split — don't ask one small model to do everything:

• Fine-tune → how it speaks (persona, values, refusal patterns, tool grammar). Unsloth QLoRA on a free Colab T4, "gentle" recipe (lr 5e-5, 1 epoch, r=8). The lever is the dataset design, not the hyperparameters — terse, simple sentences a small model can actually learn.
• RAG → what it knows (facts live in an offline BM25 retriever, not the weights — baking facts into a persona teaches hallucination).
• Code → invariants (the safety watchdog stops the robot regardless of what the model says; scan_wifi lists networks and can never connect).

Source

Full project, IaC, dataset tooling and evaluation harness: https://github.com/pits2022/free-droid (GPL-3.0). The model weights are Llama derivatives and carry the Llama 3.1 Community License.