Downloads · 30 days
384
1% of all-time downloads
mrfakename/mistral-small-3.1-24b-instruct-2503-gguf
mistral-small-3.1-24b-instruct-2503-gguf is a text generation model from mrfakename. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
Downloads · 30 days
384
1% of all-time downloads
All-time downloads
26K
Public
Repo size
258 GB
Likes
17
Public
Click a slice to open those files.
.gguf275 GB · 100%
From the Hugging Face model README
Also see:
GGUF quants for Mistral Small 3.1 Instruct 24B, compatible with llama.cpp (or almost any other llama.cpp app) in the Mistral format.
Use the Mistral chat template.
Only the text component has been converted to GGUF, does not work as a vision model.
No imatrix yet, sorry!