Downloads · 30 days
40
7% of all-time downloads
dalexdavis/Mistral-7B-Instruct-v0.3-Q4_K_M-GGUF
Mistral-7B-Instruct-v0.3-Q4_K_M-GGUF is a text generation model from dalexdavis. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
Quantised GGUF version of mistralai/Mistral-7B-Instruct-v0.3, quantised using llama.cpp.
Downloads · 30 days
40
7% of all-time downloads
All-time downloads
577
Public
Repo size
4.4 GB
Likes
0
Public
Click a slice to open those files.
.gguf4.4 GB · 100%
From the Hugging Face model README
Quantised GGUF version of mistralai/Mistral-7B-Instruct-v0.3, quantised using llama.cpp.
This model was quantised primarily for use with OpenMarker — an open source AI assistant designed to help professors, lecturers, and educators automatically grade and review student work.
OpenMarker uses local quantised models so that:
If you're an educator or developer, check out the project and contribute! 👉 https://github.com/theDALEX/openmarker
| Quant | Size | Description |
|---|---|---|
| Q4_K_M | ~4.1GB | Good quality, recommended for most use cases |
Quantised using llama.cpp release b4821 on Windows.
This is a quantised version of the original open source model by Mistral AI, released under the Apache 2.0 license.