Downloads · 30 days
8.8K
3% of all-time downloads
CarbonBeagle-11B
vicgalle/CarbonBeagle-11B
CarbonBeagle-11B is a text generation model from vicgalle. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as cc-by-nc-sa-4.0.
An experiment in merging models of different architectures and sizes. Here are the steps:
All-time downloads
267K
Public
Parameters
10.7B
21.5 GB on disk
Likes
9
Public
Repo makeup
Click a slice to open those files.
.safetensors21.5 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- cc-by-nc-sa-4.0
- Model type
- mistral
- Access
- Public
- Created
- Jan 21, 2024
- Updated
- Jun 24, 2025
- SHA
- 9a2a5868
Try a prompt
Base models
Model card
From the Hugging Face model README
CarbonBeagle-11B
An experiment in merging models of different architectures and sizes. Here are the steps:
- Upscale mlabonne/NeuralBeagle14-7B to vicgalle/franken-Beagle-11B.
- DPO-tune vicgalle/franken-Beagle-11B to vicgalle/NeuralBeagle-11B.
- Merge vicgalle/NeuralBeagle-11B and jeonsworld/CarbonVillain-en-10.7B-v4.
Merge Details
Merge Method
This model was merged using the linear merge method.
Models Merged
The following models were included in the merge:
Configuration
The following YAML configuration was used to produce this model:
models:
- model: jeonsworld/CarbonVillain-en-10.7B-v4
parameters:
weight: 1.0
- model: vicgalle/NeuralBeagle-11B
parameters:
weight: 0.5
merge_method: linear
dtype: float16
Evaluations
At the time of its creation (21-01-2024), it is the best model in the Open LLM Leaderboard for its size class (10.7B-11B), and also 13B models:
Open LLM Leaderboard Evaluation Results
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 74.64 |
| AI2 Reasoning Challenge (25-Shot) | 71.84 |
| HellaSwag (10-Shot) | 88.93 |
| MMLU (5-Shot) | 66.62 |
| TruthfulQA (0-shot) | 69.43 |
| Winogrande (5-shot) | 84.06 |
| GSM8k (5-shot) | 66.94 |
Open LLM Leaderboard Evaluation Results
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 22.36 |
| IFEval (0-Shot) | 54.15 |
| BBH (3-Shot) | 33.06 |
| MATH Lvl 5 (4-Shot) | 5.51 |
| GPQA (0-shot) | 6.94 |
| MuSR (0-shot) | 9.19 |
| MMLU-PRO (5-shot) | 25.29 |
Notice
- Part of the model is derived from CC-BY-NC-SA-licensed work
- Hence, the model cannot be used for commercial purposes
- And redistribution must be under the same license (CC-BY-NC-SA 4.0)
- Task
- Text Generation
- Library
- transformers
- Type
- mistral
- License
- cc-by-nc-sa-4.0
- Featherless Ai
- live
- Created
- Jan 21, 2024
- Updated
- Jun 24, 2025