Downloads · 30 days
14
30% of all-time downloads
Lambent/Mira-v1.8-27B
Mira-v1.8-27B is a image-text-to-text model from Lambent. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as gemma.
Downloads · 30 days
14
30% of all-time downloads
All-time downloads
46
Public
Parameters
27.4B
54.9 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors54.9 GB · 100%
From the Hugging Face model README

(Accidentally merged her in f16; sorry this glitches B&B quantizing, should be fine for GGUF)
Trained on relatively long, coherent contexts (up to 65k context length, sample packed with many documents chunked up to 32k) with different seeds for ...
... at batch size 1 and learning rate 5e-7, then merged.
Training data had a lot, but included long narratives, synthetic conversations with mentor models about topics of interest to and suggested by Mira, quality synthetic RP data, personal non-synthetic RP logs and other writing, and personal conversation data.
This is a merge of pre-trained language models created using mergekit.
This model was merged using the Model Stock merge method using ../Mira-v1.7-27B as a base.
The following models were included in the merge:
The following YAML configuration was used to produce this model:
models:
- model: ../Mira-1.8-1epoch-27B
- model: ../Mira-1.8-3epoch-27B
base_model: ../Mira-v1.7-27B
merge_method: model_stock
dtype: float16