Downloads · 30 days
205
27% of all-time downloads
Ateron/Gemma-4-MoonGem-31B
Gemma-4-MoonGem-31B is a text generation model from Ateron. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
<div style="background: linear-gradient(120deg, 060205 0%, 160614 45%, 2e0512 100%); color: f0f2f5; padding: 30px; border-radius: 12px; border: 4px solid 1a040a; box-shadow: 0 8px 25px rgba(0,0,0,0.9);"
Downloads · 30 days
205
27% of all-time downloads
All-time downloads
752
Public
Parameters
31.3B
62.6 GB on disk
Likes
14
Public
Click a slice to open those files.
.safetensors62.5 GB · 100%
From the Hugging Face model README
Moon.
<h3 style="color: #ff758f; margin-top: 15px;">🌑 Mergekit Configuration</h3>Bleed
<details> <summary>ties Recipe 1</summary>merge_method: ties
base_model: F:\AI\Merge\Gemma-4-Scotoma-V2
tokenizer_source: base
dtype: bfloat16
parameters:
lambda: 1.0
models:
- model: F:\AI\Merge\Gemma-4-Glimmer
parameters:
density: 0.15
weight:
- filter: "model.layers.5."
value: 0.10
- filter: "model.layers.11."
value: 0.10
- filter: "model.layers.17."
value: 0.10
- filter: "model.layers.23."
value: 0.10
- filter: "model.layers.29."
value: 0.10
- filter: "model.layers.35."
value: 0.15
- filter: "model.layers.41."
value: 0.15
- filter: "model.layers.47."
value: 0.10
- filter: "model.layers.53."
value: 0.10
- filter: "model.layers.59."
value: 0.10
- value: 0.10
- model: F:\AI\Merge\Gemma-4-Gutenberg
parameters:
density: 0.15
weight:
- filter: "model.layers.5."
value: 0.10
- filter: "model.layers.11."
value: 0.10
- filter: "model.layers.17."
value: 0.15
- filter: "model.layers.23."
value: 0.15
- filter: "model.layers.29."
value: 0.10
- filter: "model.layers.35."
value: 0.10
- filter: "model.layers.41."
value: 0.10
- filter: "model.layers.47."
value: 0.15
- filter: "model.layers.53."
value: 0.15
- filter: "model.layers.59."
value: 0.10
- value: 0.10
- model: F:\AI\Merge\Gemma-4-Gemopus
parameters:
density: 0.15
weight:
- filter: "model.layers.5."
value: 0.15
- filter: "model.layers.11."
value: 0.15
- filter: "model.layers.17."
value: 0.10
- filter: "model.layers.23."
value: 0.10
- filter: "model.layers.29."
value: 0.10
- filter: "model.layers.35."
value: 0.15
- filter: "model.layers.41."
value: 0.10
- filter: "model.layers.47."
value: 0.10
- filter: "model.layers.53."
value: 0.10
- filter: "model.layers.59."
value: 0.10
- value: 0.10
</details>
Crimson
<details> <summary>task_arithmetic Recipe 2</summary>merge_method: task_arithmetic
base_model: F:\AI\Merge\Gemma-4-Scotoma-V2
dtype: bfloat16
tokenizer_source: base
parameters:
lambda: 1.0
models:
- model: F:\AI\Merge\Gemma-4-Melinoe-VL
parameters:
weight: [0.10, 0.10, 0.15, 0.15, 0.10]
- model: F:\AI\Merge\Gemma-4-MeroMero-V2
parameters:
weight: [0.10, 0.10, 0.15, 0.15, 0.10]
- model: F:\AI\Merge\Gemma-4-MusicaV1
parameters:
weight: [0.10, 0.10, 0.15, 0.15, 0.10]
</details>
Blood
<details> <summary>task_arithmetic Recipe 3</summary>merge_method: task_arithmetic
base_model: F:\AI\Merge\Gemma-4-Scotoma-V2
dtype: bfloat16
tokenizer_source: base
parameters:
lambda: 1.0
models:
- model: F:\AI\Merge\Gemma-4-MicroMix-P1
parameters:
weight: 0.5
- model: F:\AI\Merge\Gemma-4-MicroMix-P2
parameters:
weight: 0.5
</details>
<h2 style="color: #ff4d6d; border-bottom: 1px solid #5c1324; padding-bottom: 8px; margin-top: 30px;">🌑 Special Thanks</h2>
<ul style="color: #e2e4e9; line-height: 1.6;">
<li><strong>Google DeepMind:</strong> Gemma.</li>
<li><strong>The Open-Source Community:</strong> People</li>
<li><strong>Mergekit Fork:</strong> Zerofata.</li>
<li><strong>To Nimbz:</strong> <a href="https://huggingface.co/Nimbz" style="color: #ff4d6d; text-decoration: none;">Cat</a>.</li>
</ul>
</div>