Downloads · 30 days
8
22% of all-time downloads
NemoMerge-12B-DellaV1b
jsfs11/NemoMerge-12B-DellaV1b
NemoMerge-12B-DellaV1b is a machine learning model from jsfs11. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
NemoMerge-12B-DellaV1b is a merge of the following models using mergekit: Gryphe/Pantheon-RP-1.5-12b-Nemo anthracite-org/magnum-12b-v2 grimjim/mistralai-Mistral-Nemo-Base-2407
All-time downloads
36
Public
Parameters
12.2B
24.5 GB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors24.5 GB · 100%
At a glance
- License
- apache-2.0
- Model type
- mistral
- Access
- Public
- Created
- Aug 9, 2024
- Updated
- Aug 9, 2024
- SHA
- 0e8190bf
Model card
From the Hugging Face model README
NemoMerge-12B-DellaV1b
NemoMerge-12B-DellaV1b is a merge of the following models using mergekit:
- Gryphe/Pantheon-RP-1.5-12b-Nemo
- anthracite-org/magnum-12b-v2
- grimjim/mistralai-Mistral-Nemo-Base-2407
🧩 Configuration
models:
- model: Gryphe/Pantheon-RP-1.5-12b-Nemo
parameters:
weight: 0.33
density: 0.7
- model: anthracite-org/magnum-12b-v2
parameters:
weight: 0.33
density: 0.7
- model: grimjim/mistralai-Mistral-Nemo-Base-2407
parameters:
weight: 0.33
density: 0.65
merge_method: della
base_model: grimjim/mistralai-Mistral-Nemo-Base-2407
parameters:
int8_mask: true
normalize: true
epsilon: 0.05
lambda: 1.0
dtype: bfloat16
- Type
- mistral
- License
- apache-2.0
- Created
- Aug 9, 2024
- Updated
- Aug 9, 2024