mafia-gemma-4-12B-it-gguf

<div align="center"> <h1>Mafia Gemma 4 12B IT GGUF</h1> </div> <p align="center"> <a href="https://huggingface.co/spaces/build-small-hackathon/mafia" target="_blank">Playable Mafia Space</a> | <a href="https://huggingface.co/datasets/Alfaxad/mafia-dataset" target="_blank">Training Dataset</a> | <a href="https://huggingface.co/Alfaxad/mafia-gemma-4-12B-it" target="_blank">Merged Transformers Model</a> | <a href="https://huggingface.co/unsloth/gemma-4-12b-it" target="_blank">Base Model</a> </p>

[!NOTE] This repository contains the GGUF Q8_0 runtime build for mafia-gemma-4-12B-it, a role-conditioned social-deduction fine-tune of Gemma 4 12B IT. The benchmark tables below report BF16 and Q8_0 together as one model family, mafia-gemma-4-12B-it, because the two repositories are deployment formats of the same trained agent policy.

Model Overview

Mafia Gemma 4 12B IT is designed for seven-player Mafia / Werewolf style games where an agent may be assigned Mafia, Detective, Doctor, or Villager at random. This GGUF repository is intended for llama.cpp-based local or server inference.

The model was trained to improve:

• legal JSON/action formatting;
• role-conditioned choices for Mafia, Detective, Doctor, and Villager;
• public discussion, accusation, defense, claim, and vote behavior;
• belief, claim, suspicion, and deception tracking;
• night actions such as Mafia kills, Doctor protects, and Detective checks;
• compatibility with moderated multi-day Mafia games using classic win conditions.

Available Files

For text-only Mafia play, use gemma-4-12b-it.Q8_0.gguf.

Training Data

Fine-tuning used the unified Alfaxad/mafia-dataset, a canonical event-log corpus built for social-deduction agents. The dataset combines converted and normalized examples from:

• Mini-Mafia style action primitives and role-conditioned decisions;
• LLMafia / Time-to-Talk style communication and timing data;
• Bayesian Social Deduction / GRAIL belief and role-count examples;
• Werewolf / Wolf-Enhance style debate traces after conversion to the Mafia schema;
• WOLF-inspired deception, suspicion, claim, and voting labels where available;
• our seven-player harness logs with 2 Mafia, 1 Detective, 1 Doctor, and 3 Villagers.

The schema separates public transcript, private role information, legal action sets, hidden state, votes, night actions, claims, and outcome labels. Hidden information is intentionally represented in the training rows only where the acting role is allowed to see it.

Fine-Tuning And Conversion

• Base model: unsloth/gemma-4-12b-it
• Method: LoRA SFT with Unsloth and TRL
• LoRA: rank 32, alpha 64
• Context length: 4096 tokens
• Training sample: 60k train rows
• Validation/test sample: 2k validation rows, 2k test rows
• Optimizer steps: 1000
• Final eval loss: 0.57703
• Final train loss: 0.04144
• GGUF quantization: Q8_0
• GGUF SHA-256: e1c320c43638bb0fde6986f669eada9850ac89d02acf7ba627efb87ea69e0572

How to Run

Use a Gemma 4 capable llama.cpp build. Older llama.cpp builds may fail with an unknown architecture error for gemma4.

Download the files:

hf download Alfaxad/mafia-gemma-4-12B-it-gguf \
  gemma-4-12b-it.Q8_0.gguf \
  gemma-4-12b-it.BF16-mmproj.gguf \
  --local-dir ./mafia-gemma-4-12b-it-gguf

Run text-only inference:

llama-cli \
  -m ./mafia-gemma-4-12b-it-gguf/gemma-4-12b-it.Q8_0.gguf \
  --jinja \
  --temp 1.0 \
  --top-p 0.95 \
  --top-k 64 \
  -p "Role: Doctor. Alive players: Ada, Blake, Casey, Devon. Night 2 action: choose one player to protect. Return compact JSON."

Run a local server:

llama-server \
  -m ./mafia-gemma-4-12b-it-gguf/gemma-4-12b-it.Q8_0.gguf \
  --jinja \
  -c 4096 \
  --temp 1.0 \
  --top-p 0.95 \
  --top-k 64 \
  --host 0.0.0.0 \
  --port 8080

Full-Game Evaluation

The table below combines the results of merged BF16 and GGUF Q8_0 deployments as one model family, mafia-gemma-4-12B-it. Results come from 24 full seven-player games, with every player using HOLY GRAIL v4 and the non-player moderator fixed to base Gemma 4 12B BF16 using a Time-to-Talk scheduler plus generator. The benchmark included 20 pairwise local-vs-frontier games and 4 mixed all-star games. Total API/player/moderator errors: 0.

Overall Slot Scoreboard

Pairwise Local-vs-Frontier Results

mafia-gemma-4-12B-it combines BF16 and Q8_0 rows. Each opponent has four local-side trials: two with Mafia Gemma controlling Mafia and two with Mafia Gemma controlling Good.

Role Diagnostics

Runtime Call Metrics

Latency is runtime and provider dependent, so use this as an operational reference rather than a pure capability ranking.

Intended Use

This model is intended for game agents, research harnesses, and AI-native social-deduction experiences. It works best when paired with:

• an authoritative game engine that enforces legal actions;
• strict public/private view isolation;
• role-specific prompts;
• an external memory/ledger layer such as HOLY GRAIL;
• a moderator that controls turn timing and table flow.

Limitations

• The full-game benchmark is small and game-specific. It should not be treated as a broad general reasoning benchmark.
• The model is not a security boundary. Hidden-role secrecy must be enforced by the engine and prompt construction.
• The model is tuned for Mafia-style game behavior, including in-game deception. Do not use it for real-world deception, impersonation, or misinformation.
• Best behavior depends on structured prompts and legal-action validation.

License

This model is distributed under the Apache 2.0 license, following the base Gemma 4 license information provided by the upstream model card.