Downloads · 30 days
22
7% of all-time downloads
rmehan/grandma-qwen2.5-3B-Instruct-GGUF
grandma-qwen2.5-3B-Instruct-GGUF is a text generation model from rmehan. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
A fine-tuned witty grandma chat model based on Qwen2.5-3B-Instruct, released in GGUF format for local inference.
Downloads · 30 days
22
7% of all-time downloads
All-time downloads
302
Public
Repo size
1.9 GB
Likes
0
Public
Click a slice to open those files.
.gguf1.9 GB · 100%
From the Hugging Face model README
A fine-tuned witty grandma chat model based on Qwen2.5-3B-Instruct, released in GGUF format for local inference.
This model is built for playful, clever, affectionate grandma-style conversations with warmth, humor, and personality.
This is a fine-tuned derivative of Qwen/Qwen2.5-3B-Instruct.
It is designed to respond like a witty grandmother:
This repo contains GGUF quantized files for local inference with:
llama.cppLM StudioOllamaThe intended personality is a witty grandma, not a generic assistant.
The tone should feel:
Think:
Qwen/Qwen2.5-3B-InstructThis repo includes GGUF quantizations with different quality / speed tradeoffs.
Typical guidance:
If you are unsure, start with Q4_K_M.
./llama-cli \
-m grandma-qwen2.5-3B-instruct.Q4_K_M.gguf \
-c 4096 \
--temp 0.9 \
--top-p 0.9
Create a Modelfile:
FROM ./grandma-qwen2.5-3B-instruct.Q4_K_M.gguf
Then run:
ollama create witty-grandma -f Modelfile
ollama run witty-grandma
0.85 - 0.950.94096 or higher if supported1.05 - 1.15A slightly higher temperature usually helps the witty personality come through better.
User: I feel like I’m behind in life.
Assistant: Oh, sweetheart, behind whom? Life is not a school bus, and nobody is handing out medals for arriving stressed and sleep-deprived. You are allowed to move at human speed. Now come here, take a breath, and let’s sort out what is actually worrying you.
User: I can’t sleep.
Assistant: Of course you can’t sleep. Your brain has opened a midnight department store and turned all the lights on. Let’s close the shop gently.
User: I feel lonely today.
Assistant: Oh sweetheart, some days loneliness walks in like it owns the place. It does not. Sit with me a minute. Tell me what kind of day it has been, and don’t leave out the dramatic parts.
Good for:
This is still a small fine-tuned language model and may:
It should not be relied on for:
This repo contains GGUF exports of a fine-tuned model based on Qwen/Qwen2.5-3B-Instruct.
If you want to improve the repo later, add:
Please follow the original license and usage terms of the base model:
Qwen/Qwen2.5-3B-InstructAdd any additional notes here if your fine-tuning artifacts have their own usage guidance.