Downloads · 30 days
12
30% of all-time downloads
NemoMix-12B-DellaV1b
jsfs11/NemoMix-12B-DellaV1b
NemoMix-12B-DellaV1b is a machine learning model from jsfs11. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
NNemoMix-12B-DellaV1b is an experimental merge of the following models using the dellalinear method using mergekit: BeaverAI/mistral-doryV2-12b intervitens/mini-magnum-12b-v1.1
All-time downloads
40
Public
Parameters
12.2B
24.5 GB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors24.5 GB · 100%
At a glance
- License
- apache-2.0
- Model type
- mistral
- Access
- Public
- Created
- Aug 5, 2024
- Updated
- Aug 6, 2024
- SHA
- d361b45c
Model card
From the Hugging Face model README
NemoMix-12B-DellaV1b
NNemoMix-12B-DellaV1b is an experimental merge of the following models using the della_linear method using mergekit:
- BeaverAI/mistral-doryV2-12b
- intervitens/mini-magnum-12b-v1.1
- grimjim/mistralai-Mistral-Nemo-Base-2407
This merge works well, but is very horny. Extremely NSFW.
🧩 Configuration
models:
- model: BeaverAI/mistral-doryV2-12b
parameters:
weight: 0.30
density: 0.42
- model: intervitens/mini-magnum-12b-v1.1
parameters:
weight: 0.35
density: 0.66
- model: grimjim/mistralai-Mistral-Nemo-Base-2407
parameters:
weight: 0.35
density: 0.78
merge_method: della_linear
base_model: grimjim/mistralai-Mistral-Nemo-Base-2407
parameters:
int8_mask: true
normalize: true
epsilon: 0.1
lambda: 1.0
density: 0.7
dtype: bfloat16
- Type
- mistral
- License
- apache-2.0
- Created
- Aug 5, 2024
- Updated
- Aug 6, 2024