Downloads · 30 days
5
3% of all-time downloads
gcoli/Ministral-3-3B-Base-2512-Q4_K_M-GGUF
Ministral-3-3B-Base-2512-Q4_K_M-GGUF is a text generation model from gcoli. Use it when you need the model to write or continue text. It is set up for llama.cpp. The card lists the license as apache-2.0.
Text-only Q4KM GGUF quantization of mistralai/Ministral-3-3B-Base-2512. No vision projector is included.
Downloads · 30 days
5
3% of all-time downloads
All-time downloads
197
Public
Repo size
2.1 GB
Likes
0
Public
Click a slice to open those files.
.gguf2.1 GB · 100%
From the Hugging Face model README
Text-only Q4_K_M GGUF quantization of mistralai/Ministral-3-3B-Base-2512. No vision projector is included.
| File | Format | Size | SHA-256 |
|---|---|---|---|
Ministral-3-3B-Base-2512-Q4_K_M.gguf | GGUF V3 Q4_K_M | 2,147,024,224 bytes | 9a565ad0c80c9a726db01c74e35ebb6ce83adfa2ec7bdb1e074aec55039d5f18 |
The original BF16 weights were first converted to F16 GGUF with the official llama.cpp converter at tag b9402 using convert_hf_to_gguf.py --outtype f16 --mistral-format. That F16 GGUF was then quantized with the official llama-quantize build 10360 using Q4_K_M. No importance matrix was used.
The file was successfully loaded with KeyType's vendored llama.cpp b9402 runtime. Its autocomplete profile self-check passed 6 of 6 checks, and an actual decode smoke test passed.