Downloads · 30 days
5
26% of all-time downloads
shadowml_-_Macaron-7B-v2-8bits
RichardErkhov/shadowml_-_Macaron-7B-v2-8bits
shadowml_-_Macaron-7B-v2-8bits is a machine learning model from RichardErkhov. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
All-time downloads
19
Public
Parameters
7.2B
7.5 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors7.5 GB · 100%
Parameter types
How the weights are stored.
I87B · 96%
Model card
From the Hugging Face model README
Quantization made by Richard Erkhov.
Macaron-7B-v2 - bnb 8bits
- Model creator: https://huggingface.co/shadowml/
- Original model: https://huggingface.co/shadowml/Macaron-7B-v2/
Original model description:
license: apache-2.0 tags:
- merge
- mergekit
- OpenPipe/mistral-ft-optimized-1218
- mlabonne/NeuralHermes-2.5-Mistral-7B
Macaron-7B-v2
This model is a merge of the following models made with mergekit:
🧩 Configuration
models:
- model: mistralai/Mistral-7B-v0.1
# no parameters necessary for base model
- model: OpenPipe/mistral-ft-optimized-1218
parameters:
density: 0.5
weight: 0.5
- model: mlabonne/NeuralHermes-2.5-Mistral-7B
parameters:
density: 0.5
weight: 0.3
merge_method: ties
base_model: mistralai/Mistral-7B-v0.1
parameters:
normalize: true
int8_mask: true
dtype: float16
- Type
- mistral
- Created
- Apr 17, 2025
- Updated
- Apr 17, 2025