Downloads · 30 days
211
7% of all-time downloads
Abiray/Mistral-Medium-3.5-128B-Q4_K_M-GGUF
Mistral-Medium-3.5-128B-Q4_K_M-GGUF is a text generation model from Abiray. Use it when you need the model to write or continue text. It is set up for gguf. The card lists the license as apache-2.0.
Config Bug Fix: A bug was recently discovered and fixed in the original model's Transformers config, which propagated to the initial GGUF release. This repository has now been updated with the newly fixed weights/conf…
Downloads · 30 days
211
7% of all-time downloads
All-time downloads
2.9K
Public
Repo size
78.4 GB
Likes
4
Public
Click a slice to open those files.
.gguf74.9 GB · 100%
From the Hugging Face model README
Transformers config, which propagated to the initial GGUF release. This repository has now been updated with the newly fixed weights/config.
This repository contains the Q4_K_M GGUF quantized version of Mistral-Medium-3.5-128B.
mistralai/Mistral-Medium-3.5-128BThis model requires the standard Mistral instruction format to function correctly and avoid hallucination or broken outputs.
<s>[SYSTEM_PROMPT]{system_prompt}[/SYSTEM_PROMPT][MODEL_SETTINGS]{"reasoning_effort": "none"}[/MODEL_SETTINGS][INST]{prompt}[/INST]