Downloads · 30 days
86
3% of all-time downloads
QuantFactory/mistral-nemo-gutades-12B-GGUF
mistral-nemo-gutades-12B-GGUF is a machine learning model from QuantFactory. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
Downloads · 30 days
86
3% of all-time downloads
All-time downloads
3.1K
Public
Repo size
111 GB
Likes
1
Public
Click a slice to open those files.
.gguf111 GB · 100%
From the Hugging Face model README
This is quantized version of nbeerbower/mistral-nemo-gutades-12B created using llama.cpp
nbeerbower/mistral-nemo-bophades-12B finetuned on jondurbin/gutenberg-dpo-v0.1.
ORPO finetuned using an RTX 3090 for 3 epochs.
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 20.76 |
| IFEval (0-Shot) | 34.25 |
| BBH (3-Shot) | 34.57 |
| MATH Lvl 5 (4-Shot) | 9.89 |
| GPQA (0-shot) | 8.72 |
| MuSR (0-shot) | 8.67 |
| MMLU-PRO (5-shot) | 28.45 |