Downloads · 30 days
188
5% of all-time downloads
alamios/Mistral-Small-3.1-DRAFT-0.5B-GGUF
Mistral-Small-3.1-DRAFT-0.5B-GGUF is a text generation model from alamios. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This model is meant to be used as draft model for speculative decoding with mistralai/Mistral-Small-3.1-24B-Instruct-2503 or mistralai/Mistral-Small-24B-Instruct-2501
Downloads · 30 days
188
5% of all-time downloads
All-time downloads
3.8K
Public
Repo size
3.4 GB
Likes
4
Public
Click a slice to open those files.
.gguf3.4 GB · 100%
From the Hugging Face model README
This model is meant to be used as draft model for speculative decoding with mistralai/Mistral-Small-3.1-24B-Instruct-2503 or mistralai/Mistral-Small-24B-Instruct-2501
The data are Mistral's outputs and includes all kind of tasks from various datasets in English, French, German, Spanish, Italian and Portuguese. It has been trained for 2 epochs on 20k unique examples, for a total of 12 million tokens per epoch.