Downloads · 30 days
8
3% of all-time downloads
Lolol857/Mephisto-JOSIE-AREX-4B
Mephisto-JOSIE-AREX-4B is a image-text-to-text model from Lolol857. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for transformers.
This is a merge of pre-trained language models created using mergekit.
Downloads · 30 days
8
3% of all-time downloads
All-time downloads
273
Public
Parameters
4.5B
9.1 GB on disk
Likes
2
Public
Click a slice to open those files.
.safetensors9.1 GB · 100%
From the Hugging Face model README
This is a merge of pre-trained language models created using mergekit.
This model was merged using the DARE TIES merge method using /kaggle/working/josie-arex-slerp as a base.
The following models were included in the merge:
The following YAML configuration was used to produce this model:
models:
- model: /kaggle/working/josie-arex-slerp
parameters:
weight: 0.40
density: 0.7
- model: CloudGoat/Mephisto-4B-0725
parameters:
weight: 0.60
density: 0.5
merge_method: dare_ties
base_model: /kaggle/working/josie-arex-slerp
parameters:
int8_mask: true
normalize: true
density: 0.6
dtype: bfloat16