Ministral-3-14B-Instruct-2512-GGUF

<img src="https://ollama.com/assets/library/mistral-nemo/72045292-694a-4867-88c8-8635c9d97030" alt="Example image" width="168" height="128"> <img src="https://ollama.com/assets/library/ministral-3/83fa3859-d87f-492c-bd81-596cfbceeccb" alt="Example image" width="64" height="64">

------------------------------------------------<br /> - Model Details and Specifications: -<br />------------------------------------------------

Ministral-3 14B Instruct 2512 (GGUF)

This release contains: <br /> Llama.cpp and Ollama compatible GGUF converted and Quantized model files (Compatible with both Ollama, and Llama.cpp)

Quantized GGUF version of:

• Ministral-3-14B-Instruct-2512-BF16 <br /> (by MistralAI)

Original Model Link:

• mistralai/Ministral-3-14B-Instruct-2512-BF16

Description: <br /> This release includes GGUF (Ollama + Llama.cpp - compatible) model files and three working multi-modal projector(s) (mmproj) files for the Vision Projector; offering full capabilities in Ollama or Llama.cpp.<br />

What's New? <br /> As of February 2026 all available GGUF (both F16 and K-Quants) files have been completely overhauled in order to offer the community what I was able to come up with as best size vs quality possible for this model from MistralAI (Thank you MistralAI for your release!). This was done by first taking the BF16 model's safetensors and up-casting them to F32, from there the model was quantized down to the currently available files you find here. Beyond the F32-->Quant conversion that is a new methodology; These GGUF F16+Quantize files also include a completely custom tokenizer chat template. <br /><br />

Why Up-Cast to F32 from BF16? <br /> Some will argue or perhaps be curious as to why the model was up-cast from BF16 to F32... This is because although it is true that there is no direct quality benefit from casting a BF16 release to a F32 bit file size, there is however a benefit of less quality loss when quantizing from an up-cast BF16 to F32 as the F32 has in a sense more "scratchpad" available mathematically and Quants derrived from an F32 inherently degrade less per-Quant compared to a direct F16 or BF16 conversion. (It's worth a Google if anyone is ever curious!) <br /><br />

What is the "Custom Tokenizer Chat Template?" <br /> As apposed to the standard "Chat Template" made available by MistralAI - this release of GGUF converted and quantized files offer a totally unique and custom Tokenizer Chat Template in order to provide: Smoother, Faster, Efficient, and Sophisticated interaction/inference with the model. This template strips away all of the "fluff" or genuinely unneeded logic from the JINJA Chat/Tokenizer Template - allowing anyone who uses the model for inferencing can enjoy a significant improvement in speed, quality and context adherence without sacrificing any aspect of the initial release by MistralAI.

For reference - here is the new JINJA Tokenizer Chat-Template: <br /> (This template features a sliding context window of EIGHT (8) interactions, which may be adjusted per-individual requirements simply by altering the third line of this template from the number nine (9) to either higher or lower numerical values to increase or decrease the sliding context window)

{%- set ns = namespace(remMessage=false, hasSys=false, injSystem=true) -%}
{%- for msg in messages -%}
	{%- if msg.role == "system" -%}
		{%- set ns.hasSys = true -%}
	{%- endif -%}
{%- endfor -%}
{%- for msg in messages -%}
	{%- if ns.injSystem -%}
		[SYSTEM_PROMPT]
		{%- if ns.hasSys -%}
			{{ msg.content }}
		{%- else -%}
'Respond to the message you receive using the same language that the message was written or the language the message requested.
Always respond directly to the user. Next sections describes the capabilities that you have.
🟦 [Multi-Modal Capability] You have the ability to read images, but not create images nor read audio/video.'
		{%- endif -%}
		[/SYSTEM_PROMPT]
		{%- set ns.injSystem = false -%}
	{%- endif -%}
	{%- if (messages|length - loop.index0) < 47 -%}
		{%- set ns.remMessage = true -%}
	{%- endif -%}
	{%- if ns.remMessage -%}
		{%- if msg.role == "user" -%}
			[INST]{{ msg.content }}[/INST]
		{%- elif msg.role == "assistant" -%}
			{{ msg.content }}
		{%- endif -%}
	{%- endif -%}
{%- endfor -%}

No modifications, edits, or configurations are required to use this model with Ollama, it works natively! Both Vision and Text work with Ollama. (^.^) <br />

Coming Soon!!! <br /> Check back occasionally - as a automated installer/configure Python-3 script is making its way to all of my releases! This allows anyone who is interested in using these models a hassle-free and stress-free experience where the Python-3 script takes care of setting up the model for Ollama (specifically for Ollama, other software optimizations coming later). It is highly recommended to use the Ollama "create" command along with the supplied ".modelfile" to ensure proper configuration for anyone who wishes to get the most out of this particular release. Though, the Python-3 automated installer/configuration tool will handle such aspects if it is chosen to be used.

Happy Inferencing! <br /> -- Jon Z (EnlistedGhost)

---

Model Updates (As of: February 27th, 2026)

• Updated: All GGUF model file(s) with significantly altered/reworked GGUF conversion(s) and Quant file(s)<br /> Final Quantized and full-F16 modelfiles are being uploaded!!! - Check back for I-Matrix quant files and other static K-Quants if you do not see your desired edition (They are being uploaded, thank you for your patience!)

---

-------------------------------------------------------------<br /> - GGUF Conversion and Quantization Details: -<br />-------------------------------------------------------------

Software used to convert Safetensors to GGUF:

• <a href="https://github.com/ggml-org/llama.cpp/">llama.cpp</a>

Software used to create Quantized GGUF Files:

• <a href="https://github.com/ggml-org/llama.cpp/">llama.cpp</a>

Specific GitHub Commit Point:

• <a href="https://github.com/ggml-org/llama.cpp/commit/94b0200a01a753eff5897dab9311f51a7bc1c62f">b8118</a>

Converted to GGUF and Quantized by:

• EnlistedGhost

---

--------------------------<br /> ---- Original Info ---- <br /> --------------------------

(Crossposted from the link in the above section: "Model Details"): <br /> <br /> <br /> <br />

Ministral 3 14B Instruct 2512 BF16

The largest model in the Ministral 3 family, Ministral 3 14B offers frontier capabilities and performance comparable to its larger Mistral Small 3.2 24B counterpart. A powerful and efficient language model with vision capabilities.

This model is the instruct post-trained version, fine-tuned for instruction tasks, making it ideal for chat and instruction based use cases.

The Ministral 3 family is designed for edge deployment, capable of running on a wide range of hardware. Ministral 3 14B can even be deployed locally, capable of fitting in 32GB of VRAM in BF16, and less than 24GB of RAM/VRAM when quantized.

We provide a no-loss FP8 version here, you can find other formats and quantizations in the Ministral 3 - Additional Checkpoints collection.

Key Features

Ministral 3 14B consists of two main architectural components:

• 13.5B Language Model
• 0.4B Vision Encoder

The Ministral 3 14B Instruct model offers the following capabilities:

• Vision: Enables the model to analyze images and provide insights based on visual content, in addition to text.
• Multilingual: Supports dozens of languages, including English, French, Spanish, German, Italian, Portuguese, Dutch, Chinese, Japanese, Korean, Arabic.
• System Prompt: Maintains strong adherence and support for system prompts.
• Agentic: Offers best-in-class agentic capabilities with native function calling and JSON outputting.
• Edge-Optimized: Delivers best-in-class performance at a small scale, deployable anywhere.
• Apache 2.0 License: Open-source license allowing usage and modification for both commercial and non-commercial purposes.
• Large Context Window: Supports a 256k context window.

Use Cases

Private AI deployments where advanced capabilities meet practical hardware constraints:

• Private/custom chat and AI assistant deployments in constrained environments
• Advanced local agentic use cases
• Fine-tuning and specialization
• And more...

Bringing advanced AI capabilities to most environments.

Ministral 3 Family

Other formats available here.

Benchmark Results

We compare Ministral 3 to similar sized models.

Reasoning

Instruct

Base

License

This model is licensed under the Apache 2.0 License.

You must not use this model in a manner that infringes, misappropriates, or otherwise violates any third party’s rights, including intellectual property rights.