Downloads · 30 days
10
10% of all-time downloads
grimjim/Mistral-Nemo-Instruct-2407-12B-Xmerge-test1
Mistral-Nemo-Instruct-2407-12B-Xmerge-test1 is a text generation model from grimjim. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This is a novel merge of pre-trained language models created using mergekit.
Downloads · 30 days
10
10% of all-time downloads
All-time downloads
102
Public
Parameters
12.2B
24.5 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors24.5 GB · 100%
From the Hugging Face model README
This is a novel merge of pre-trained language models created using mergekit.
This model was merged using the DeLERP merge method using grimjim/mistralai-Mistral-Nemo-Base-2407 as a base.
DeLERP is a novel merge method, a variation on LERP, implemented within the mergekit framework. More details will be released later.
The following models were included in the merge:
The following YAML configuration was used to produce this model:
models:
- model: grimjim/mistralai-Mistral-Nemo-Instruct-2407
- model: grimjim/mistralai-Mistral-Nemo-Base-2407
merge_method: delerp
base_model: grimjim/mistralai-Mistral-Nemo-Base-2407
parameters:
t:
- value: 0.999
dtype: bfloat16