Downloads · 30 days
16
4% of all-time downloads
Mistral-Small-24B-Instruct-2501-GGUF
ddh0/Mistral-Small-24B-Instruct-2501-GGUF
Mistral-Small-24B-Instruct-2501-GGUF is a machine learning model from ddh0. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
This repo provides two GGUF quantizations of mistralai/Mistral-Small-24B-Instruct-2501:
All-time downloads
395
Public
Repo size
33.7 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.gguf33.7 GB · 100%
At a glance
- License
- apache-2.0
- Access
- Public
- Created
- Jan 30, 2025
- Updated
- Jan 30, 2025
- SHA
- 904de1d5
Base models
Model card
From the Hugging Face model README
Mistral-Small-24B-Instruct-2501-GGUF
This repo provides two GGUF quantizations of mistralai/Mistral-Small-24B-Instruct-2501:
| Filename | File size | Description | TLDR |
|---|---|---|---|
| Mistral-Small-24B-Instruct-2501-q8_0-q4_K_S.gguf | 14.05GB | q4_K_S quantization using q8_0 for token embeddings and output tensors | Good quality, smaller size |
| Mistral-Small-24B-Instruct-2501-q8_0-q6_K.gguf | 19.67GB | q6_K quantization using q8_0 for token embeddings and output tensors | Practically perfect quality, larger size |
- License
- apache-2.0
- Created
- Jan 30, 2025
- Updated
- Jan 30, 2025