Downloads · 30 days
165
7% of all-time downloads
RichardErkhov/v000000_-_Qwen2.5-14B-Gutenberg-Instruct-Slerpeno-gguf
v000000_-_Qwen2.5-14B-Gutenberg-Instruct-Slerpeno-gguf is a machine learning model from RichardErkhov. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Downloads · 30 days
165
7% of all-time downloads
All-time downloads
2.4K
Public
Repo size
170 GB
Likes
0
Public
Click a slice to open those files.
.gguf197 GB · 100%
From the Hugging Face model README
Quantization made by Richard Erkhov.
Qwen2.5-14B-Gutenberg-Instruct-Slerpeno - GGUF
license: apache-2.0 library_name: transformers tags:

This is a merge of pre-trained language models created using mergekit.
This model was merged using the SLERP merge method. (sophosympatheia gradient)
The following models were included in the merge:
The following YAML configuration was used to produce this model:
models:
- model: Qwen/Qwen2.5-14B-Instruct
merge_method: slerp
base_model: v000000/Qwen2.5-14B-Gutenberg-1e-Delta
parameters:
t:
- value: [0, 0, 0.3, 0.4, 0.5, 0.6, 0.5, 0.4, 0.3, 0, 0]
dtype: bfloat16
The idea here is that Gutenberg DPO stays in the output/input 100% while merging smoothly with the base instruct model in the deeper layers to heal loss and increase intelligence.
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 33.39 |
| IFEval (0-Shot) | 48.55 |
| BBH (3-Shot) | 49.74 |
| MATH Lvl 5 (4-Shot) | 19.71 |
| GPQA (0-shot) | 15.21 |
| MuSR (0-shot) | 18.43 |
| MMLU-PRO (5-shot) | 48.68 |