Distil-NPC-gemma-3-1b-it-iMatrix-GGUF

Distil-NPC-gemma-3-1b-it

A small language model (SLM) fine-tuned by Distil Labs for interacting with non-playable characters using natural language.

Model Details

• Developed by: Distil Labs GmbH
• License: Gemma3 License Agreement
• Finetuned from: google/gemma-3-270m

Intended Use & Limitations

• Use cases: Redacting support chats, logs, tickets, transcripts—removing identity while preserving ops signals (IDs last-4, order numbers, etc.).
• Out of scope: Legal or compliance advice; languages beyond English (generalization not guaranteed); domain-specific IDs unseen in training.

Input & Output

Input: A plain-text prompt with a question along with the character the question is asked to. For example:

Character: Arin the Cleric
Have you ever had to defend your faith?

For a list of available characters along with their biographies, please refer to the data in the following repository: https://github.com/distil-labs/Distil-NPCs

---

Model creator: distil-labs<br/> Original model: distil-labs/Distil-NPC-gemma-3-1b-it<br/> GGUF quantization: provided by Novaciano using llama.cpp<br/>

Special thanks

🙏 Special thanks to Georgi Gerganov and the whole team working on llama.cpp for making all of this possible.

Use with Ollama

ollama run "hf.co/Novaciano/Distil-NPC-gemma-3-1b-it-iMatrix-GGUF:Q4_K_M"

Use with LM Studio

lms load "Novaciano/Distil-NPC-gemma-3-1b-it-iMatrix-GGUF"

Use with llama.cpp CLI

llama-cli --hf "Novaciano/Distil-NPC-gemma-3-1b-it-iMatrix-GGUF:Q4_K_M" -p "The meaning to life and the universe is"

Use with llama.cpp Server:

llama-server --hf "Novaciano/Distil-NPC-gemma-3-1b-it-iMatrix-GGUF:Q4_K_M" -c 4096