europa-9b-GGUF

Diabase Europa 9B v1.0

A locally runnable, Swedish-enhanced European AI assistant built on Gemma 2 9B Instruct.

Diabase Europa 9B is a light fine-tune for Swedish and European enterprise use: clearer instruction following, better Swedish assistant behavior, and practical answers on AI, data, compliance, and sovereign deployment topics. It is designed to run on your own hardware without sending prompts to a third-party API.

This repository ships a merged GGUF (Q4_K_M) plus an Ollama Modelfile with the release system prompt baked in. One download, three commands, ready to chat.

---

Quick start (Ollama, recommended)

Prerequisites: Ollama installed, Gemma license accepted on Hugging Face if required by your org.

# 1. Download model files from this repo
huggingface-cli download diabase/europa-9b-GGUF gemma-2-9b-it.Q4_K_M.gguf Modelfile

# 2. Create the local model (includes Diabase system prompt)
cd <download-folder>
ollama create diabase-europa-9b -f Modelfile

# 3. Run
ollama run diabase-europa-9b

Try it:

Svara på svenska: Vad är Diabase Europa och hur skiljer det sig från amerikanska AI-tjänster?

Expected behavior: third-person description, natural Swedish, uses öppna vikter rather than invented calques like öppenkälla.

---

What is in this repo

The system prompt is intentionally public in Modelfile. It is not hidden during inspection (ollama show diabase-europa-9b --modelfile), but it is not shown in normal chat. You may customize it for your deployment.

---

What this model is

• A Gemma 2 9B Instruct derivative with a light QLoRA SFT adapter merged in
• Tuned for Swedish assistant behavior, European context, and enterprise AI topics
• Open-weight and locally deployable on consumer hardware
• Transparently evaluated on EuroEval Swedish benchmarks

What this model is not

• Not trained from scratch on Swedish corpora
• Not a frontier-scale model competing with GPT-4 class systems on raw capability
• Not a safety-certified or compliance-certified product out of the box
• Not a replacement for legal, medical, or security review by qualified professionals

---

Intended use

• Swedish and multilingual assistant workflows in European organizations
• On-prem or private cloud deployments where data residency matters
• AI/ML, data engineering, compliance, and sovereign AI education and drafting
• Prototyping European AI products before heavier customization

Out of scope

• Fully autonomous decision-making without human review
• High-stakes legal, medical, or financial advice without expert validation
• Claims of automatic GDPR, NIS2, or EU AI Act compliance from model use alone
• Environments requiring formal safety red-teaming or guaranteed factual accuracy

---

Evaluation (EuroEval Swedish)

Compared against the same base model (unsloth/gemma-2-9b-it-bnb-4bit) under identical eval settings (4-bit, vLLM, 4096 context, Triton).

Summary: Knowledge and reasoning are preserved within noise. The clearest win is instruction following (+1.7 IFEval). This is a polish on a strong base, not a leaderboard revolution. That is by design: we optimized for a safe, deployable Swedish assistant rather than benchmark chasing at the cost of general capability.

Full baseline documented in the Diabase model lab release materials.

---

Example output

Prompt: Vad är Diabase Europa och hur skiljer det sig från amerikanska AI-tjänster?

Response (Ollama, v1.0):

Diabase Europa är en AI-assistent med öppna vikter, byggd för svenska och europeiska sammanhang. Den är anpassad för svenska språket och europeiska behov. Diabase Europa är utformad med fokus på integritet, praktisk användbarhet och lokal relevans.

Skillnaden mot många amerikanska AI-tjänster ligger i fokus. Diabase Europa är tänkt att användas i europeiska sammanhang med hänsyn till GDPR, dataresidency och andra europeiska krav...

---

Other ways to run

llama.cpp

./llama-cli \
  -m gemma-2-9b-it.Q4_K_M.gguf \
  -p "<start_of_turn>user\nHej! Förklara kort vad fine-tuning är.<end_of_turn>\n<start_of_turn>model\n" \
  -n 256 \
  --temp 0.7

For llama.cpp, supply the system prompt manually or via your client. See the SYSTEM block in Modelfile.

Transformers + LoRA (advanced, for fine-tuning)

Use the separate LoRA adapter repo if you want to continue training or serve via PEFT:

from pathlib import Path
import torch
from peft import PeftModel
from transformers import AutoModelForCausalLM, AutoTokenizer, BitsAndBytesConfig

BASE = "unsloth/gemma-2-9b-it-bnb-4bit"
ADAPTER = "diabase/europa-9b-v1.0-lora"

system = Path("prompts/diabase_europa_v1_system.txt").read_text(encoding="utf-8").strip()

tokenizer = AutoTokenizer.from_pretrained(BASE)
model = AutoModelForCausalLM.from_pretrained(
    BASE,
    quantization_config=BitsAndBytesConfig(load_in_4bit=True),
    device_map="auto",
    torch_dtype=torch.bfloat16 if torch.cuda.is_bf16_supported() else torch.float16,
)
model = PeftModel.from_pretrained(model, ADAPTER)
model.eval()

messages = [
    {"role": "system", "content": system},
    {"role": "user", "content": "Svara på svenska: Vad innebär digital suveränitet?"},
]
prompt = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
inputs = tokenizer(prompt, return_tensors="pt").to(model.device)

with torch.no_grad():
    out = model.generate(**inputs, max_new_tokens=256, do_sample=False)

print(tokenizer.decode(out[0][inputs["input_ids"].shape[-1]:], skip_special_tokens=True))

---

Training

Diabase Europa v1.0 uses a light SFT recipe directly on Gemma 2 9B Instruct. No continued pre-training. No aggressive full-model fine-tuning.

Training data (~575 synthetic instruction examples)

All examples are synthetically generated. No personal data or private information. Human-reviewed curation is planned for v1.1.

---

Limitations

• Early-stage release. Strongest as a Swedish/European assistant polish on Gemma 2, not a from-scratch Swedish foundation model.
• Small SFT set. Shapes behavior and tone; does not inject large amounts of new knowledge.
• Hallucinations. Can produce plausible but incorrect answers. Verify important facts.
• Terminology. Improves with the bundled system prompt; some edge cases remain. DPO and human-reviewed data planned for v1.1.
• Safety. Inherits Gemma 2 safety training. No dedicated Diabase red-teaming yet.
• Benchmark variance. Small regressions on some EuroEval tasks are within expected noise for light SFT.

---

Roadmap

---

About Diabase

Diabase builds European AI infrastructure for organizations that want open-weight models, local deployment, and transparent evaluation. We document what we train, what we measure, and what we do not claim.

Links

• Website: diabase.ai
• LoRA adapter: diabase/europa-9b-v1.0-lora

---

Citation

@misc{diabase_europa_9b_2026,
  author       = {Diabase AI},
  title        = {Diabase Europa 9B v1.0},
  year         = {2026},
  publisher    = {Hugging Face},
  howpublished = {\url{https://huggingface.co/diabase/europa-9b-GGUF}}
}

---

License

This model is derived from Gemma 2 9B IT and is subject to the Gemma Terms of Use.

Diabase fine-tuning artifacts, documentation, and the bundled system prompt are provided under the Apache 2.0 License where applicable. You must comply with both the Gemma license and applicable law when using, modifying, or redistributing this model.