Downloads · 30 days
20
3% of all-time downloads
ForSureTesterSim/QwenR1-7B-Breadcrumbs-TIES
QwenR1-7B-Breadcrumbs-TIES is a text generation model from ForSureTesterSim. Use it when you need the model to write or continue text. It is set up for transformers.
This is a merge of pre-trained language models created using mergekit.
Downloads · 30 days
20
3% of all-time downloads
All-time downloads
624
Public
Parameters
7.6B
15.2 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors15.2 GB · 100%
From the Hugging Face model README
This is a merge of pre-trained language models created using mergekit.
This model was merged using the Model Breadcrumbs with TIES merge method using deepseek-ai/DeepSeek-R1-Distill-Qwen-7B as a base.
The following models were included in the merge:
The following YAML configuration was used to produce this model:
merge_method: breadcrumbs_ties
base_model: deepseek-ai/DeepSeek-R1-Distill-Qwen-7B
parameters:
density: 0.15 # Retain top 15% (Trims bottom 85% SFT noise)
gamma: 0.99 # Trim the top 1% (Destroys extreme RL outliers)
weight: 1.0
models:
- model: nvidia/AceReason-Nemotron-7B
- model: ./padded-maestro
- model: POLARIS-Project/Polaris-7B-Preview
dtype: bfloat16