Downloads · 30 days
313
2% of all-time downloads
EmbeddedLLM_-_Mistral-7B-Merge-14-v0.5-gguf
RichardErkhov/EmbeddedLLM_-_Mistral-7B-Merge-14-v0.5-gguf
EmbeddedLLM_-_Mistral-7B-Merge-14-v0.5-gguf is a machine learning model from RichardErkhov. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
All-time downloads
12.6K
Public
Repo size
82.2 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf95.2 GB · 100%
At a glance
- Access
- Public
- Created
- Jul 4, 2024
- Updated
- Jul 4, 2024
- SHA
- d7fae666
Model card
From the Hugging Face model README
Quantization made by Richard Erkhov.
Mistral-7B-Merge-14-v0.5 - GGUF
- Model creator: https://huggingface.co/EmbeddedLLM/
- Original model: https://huggingface.co/EmbeddedLLM/Mistral-7B-Merge-14-v0.5/
Original model description:
license: cc-by-nc-4.0 language:
- en tags:
- merge base_model:
- EmbeddedLLM/Mistral-7B-Merge-14-v0.3
- Weyaxi/OpenHermes-2.5-neural-chat-v3-3-openchat-3.5-1210-Slerp
- openchat/openchat-3.5-0106
- mlabonne/NeuralMarcoro14-7B
Update 2024-01-21
Due to mlabonne/NeuralMarcoro14-7B updating its license to CC-BY-NC, our license will follow suit.
Model Description
This is an experiment to test merging 14 models using DARE TIES 🦙
- We first merge 14 models to produce EmbeddedLLM/Mistral-7B-Merge-14-v0.3.
- The model is merged again using DARE TIES with:
Open LLM Leaderboard
| Average | 71.96 |
|---|---|
| ARC | 68.69 |
| HellaSwag | 86.45 |
| MMLU | 65.65 |
| TruthfulQA | 59.12 |
| Winogrande | 80.66 |
| GSM8K | 71.19 |
Chat Template
Either ChatML or Llama-2 chat template.
Merge Configuration
The merge config file for this model is here:
models:
- model: mistralai/Mistral-7B-v0.1
# no parameters necessary for base model
- model: EmbeddedLLM/Mistral-7B-Merge-14-v0.3
parameters:
weight: 0.3
density: 0.5
- model: Weyaxi/OpenHermes-2.5-neural-chat-v3-3-openchat-3.5-1210-Slerp
parameters:
weight: 0.2
density: 0.5
- model: openchat/openchat-3.5-0106
parameters:
weight: 0.2
density: 0.5
- model: mlabonne/NeuralMarcoro14-7B
parameters:
weight: 0.3
density: 0.5
merge_method: dare_ties
base_model: mistralai/Mistral-7B-v0.1
parameters:
int8_mask: true
tokenizer_source: union
dtype: bfloat16
- Created
- Jul 4, 2024
- Updated
- Jul 4, 2024