Downloads · 30 days
18
11% of all-time downloads
mergekit-community/mergekit-model_stock-olgorhm
mergekit-model_stock-olgorhm is a text generation model from mergekit-community. Use it when you need the model to write or continue text. It is set up for transformers.
This is a merge of pre-trained language models created using mergekit.
Downloads · 30 days
18
11% of all-time downloads
All-time downloads
161
Public
Parameters
23.6B
47.2 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors47.1 GB · 100%
From the Hugging Face model README
This is a merge of pre-trained language models created using mergekit.
This model was merged using the Model Stock merge method using mistralai/Mistral-Small-24B-Instruct-2501 as a base.
The following models were included in the merge:
The following YAML configuration was used to produce this model:
models:
- model: mistralai/Mistral-Small-24B-Instruct-2501
- model: AlSamCur123/Mistral-Small3-24B-InstructContinuedFine
parameters:
density: 0.9
weight: 0.5
- model: trashpanda-org/MS-24B-Instruct-Mullein-v0
parameters:
density: 0.9
weight: 0.5
- model: cognitivecomputations/Dolphin3.0-Mistral-24B
parameters:
density: 0.8
weight: 0.3
merge_method: model_stock
base_model: mistralai/Mistral-Small-24B-Instruct-2501
parameters:
int8_mask: true
normalize: true
dtype: float16
random_seed: -1