Downloads · 30 days
22
8% of all-time downloads
MiroThinker-1.7-mini-Q3_K_M-GGUF
kai-os/MiroThinker-1.7-mini-Q3_K_M-GGUF
MiroThinker-1.7-mini-Q3_K_M-GGUF is a text generation model from kai-os. Use it when you need the model to write or continue text. It is set up for llama.cpp. The card lists the license as apache-2.0.
This repository contains a Q3KM GGUF quantization of miromind-ai/MiroThinker-1.7-mini.
All-time downloads
270
Public
Repo size
14.7 GB
Likes
3
Public
Repo makeup
Click a slice to open those files.
.gguf14.7 GB · 100%
At a glance
- Task
- Text Generation
- Library
- llama.cpp
- License
- apache-2.0
- Access
- Public
- Created
- Mar 12, 2026
- Updated
- Mar 12, 2026
- SHA
- adb8bcce
Try a prompt
Base models
Model card
From the Hugging Face model README
MiroThinker-1.7-mini Q3_K_M GGUF
This repository contains a Q3_K_M GGUF quantization of miromind-ai/MiroThinker-1.7-mini.
Files
MiroThinker-1.7-mini.Q3_K_M.gguf
Quantization details
- Quantization:
Q3_K_M - Quantized with:
Unsloth+llama.cpp - GGUF size:
14.71 GB(13.70 GiB) - Source model license:
apache-2.0
Recommended use
This quant is aimed at fitting a 16 GB GPU while keeping better quality than lower-bit options. In local testing, it loaded successfully with llama.cpp on an AMD Radeon RX 9060 XT through the Vulkan backend.
llama.cpp example
llama-cli \
-m MiroThinker-1.7-mini.Q3_K_M.gguf \
--device Vulkan1 \
-ngl 999 \
-c 128
If VRAM is tight on your setup, reduce context length first, then reduce GPU offload.
Notes
- This repo contains only the GGUF quantized artifact, not the original safetensors weights.
- The upstream MiroThinker model itself can document deeper lineage separately.
- Task
- Text Generation
- Library
- llama.cpp
- License
- apache-2.0
- Languages
- en
- Created
- Mar 12, 2026
- Updated
- Mar 12, 2026