Downloads · 30 days
133
5% of all-time downloads
Ministral-3-14B-Instruct-2512-textonly-NVFP4
ppetermann/Ministral-3-14B-Instruct-2512-textonly-NVFP4
Ministral-3-14B-Instruct-2512-textonly-NVFP4 is a text generation model from ppetermann. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This repository contains a text-only and NVFP4-quantized derivative of:
All-time downloads
2.9K
Public
Parameters
8.2B
9.5 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors9.5 GB · 100%
Parameter types
How the weights are stored.
U86.1B · 74%
Try a prompt
Base models
Model card
From the Hugging Face model README
Ministral-3-14B-Instruct-2512 text-only NVFP4
This repository contains a text-only and NVFP4-quantized derivative of:
What this is
The original upstream checkpoint is multimodal. This repo contains:
- the text-only language model extracted from the original checkpoint
- quantized to full NVFP4
- saved in compressed-tensors format
- adjusted for vLLM loading
I'm running this with about 21 token/s per request in vllm using the openai style api on a GB10 based machine.
The Hugging Face UI may report unusual parameter and tensor-type information for this model. That is expected for compressed NVFP4 artifacts and should not be interpreted as the original dense model having changed to a literal 5B FP32/BF16 model.
Important notes
- This is not the original upstream model.
- This is not multimodal. Vision/image support was removed during extraction.
- This repo is intended primarily for vLLM serving.
- The
config.jsonwas patched to use:
"architectures": ["MistralForCausalLM"]
- Task
- Text Generation
- Library
- transformers
- Type
- ministral3
- License
- apache-2.0
- Created
- Apr 4, 2026
- Updated
- Apr 4, 2026