Downloads · 30 days
24
6% of all-time downloads
MrRikyz/StarlightMoon-Foxfire-12B
StarlightMoon-Foxfire-12B is a text generation model from MrRikyz. Use it when you need the model to write or continue text. It is set up for transformers.
<div style="width: 100%; text-align: center; padding: 40px 20px; background: radial-gradient(circle, rgba(43,0,72,0.05) 0%, rgba(10,10,35,0.02) 100%); border-radius: 20px; margin-bottom: 30px; border: 1px solid rgba(1…
Downloads · 30 days
24
6% of all-time downloads
All-time downloads
374
Public
Parameters
12.2B
24.5 GB on disk
Likes
11
Public
Click a slice to open those files.
.safetensors24.5 GB · 100%
From the Hugging Face model README
StarlightMoon-Foxfire-12B is a merge built on top of Impish_Bloodmoon_12B by SicariusSicariiStuff.
The model uses the model_stock method
This model results from a merge between:
The merge was performed using mergekit with the following parameters:
base_model: SicariusSicariiStuff/Impish_Bloodmoon_12B
dtype: float32
merge_method: model_stock
modules:
default:
slices:
- sources:
- layer_range: [0, 40]
model: SicariusSicariiStuff/Impish_Bloodmoon_12B_Abliterated
parameters:
weight: 0.54
- layer_range: [0, 40]
model: DreadPoor/Famino-12B-Model_Stock
parameters:
weight: 0.38
- layer_range: [0, 40]
model: PygmalionAI/Eleusis-12B
parameters:
weight: 0.12
- layer_range: [0, 40]
model: PygmalionAI/Pygmalion-3-12B
parameters:
weight: 0.12
- layer_range: [0, 40]
model: MrRikyz/Foxfire_Bloom
parameters:
weight: 0.22
- layer_range: [0, 40]
model: Vortex5/Azure-Starlight-12B
parameters:
weight: 0.1
- layer_range: [0, 40]
model: SicariusSicariiStuff/Impish_Bloodmoon_12B
out_dtype: bfloat16
parameters:
lambda: 0.82
normalize: 1.0
tokenizer:
source: MrRikyz/Foxfire_Bloom
</details>
Thanks to the authors of the original models for their incredible work:
Impish_Bloodmoon_12B and Impish_Bloodmoon_12B_AbliteratedFamino-12B-Model_StockEleusis-12B and PygmalionAI/Pygmalion-3-12BAzure-Starlight-12B