Downloads · 30 days
13
4% of all-time downloads
nicklas373/Ministral-3-14B-Reasoning-2512-AWQ
Ministral-3-14B-Reasoning-2512-AWQ is a image-text-to-text model from nicklas373. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for transformers.
This model Ministral-3-14B-Reasoning-2512-AWQ was converted to AWQ format, from huihui-ai/Huihui-Qwen3-VL-8B-Thinking-abliterated using llm-compressor version 0.9.0.1 (https://github.com/vllm-project/llm-compressor.gi…
Downloads · 30 days
13
4% of all-time downloads
All-time downloads
349
Public
Parameters
3.4B
19.8 GB on disk
Likes
1
Public
Click a slice to open those files.
.safetensors19.7 GB · 100%
How the weights are stored.
I3212.2B · 87%
From the Hugging Face model README
This model Ministral-3-14B-Reasoning-2512-AWQ was converted to AWQ format, from huihui-ai/Huihui-Qwen3-VL-8B-Thinking-abliterated using llm-compressor version 0.9.0.1 (https://github.com/vllm-project/llm-compressor.git). With using dataset Gemini 3 Pro Preview from TeichAI/gemini-3-pro-preview-high-reasoning-1000x
vllm serve nicklas373/Ministral-3-14B-Reasoning-2512-AWQ --config_format mistral --dtype auto --enable-auto-tool-choice --tool-call-parser mistral --reasoning-parser mistral --load_format mistral --served-model-name Ministral-3-14B-Reasoning-2512- --seed 0 --quantization compressed-tensors --tokenizer 'mistralai/Ministral-3-14B-Reasoning-2512' --tokenizer_mode mistral