Downloads · 30 days
11
15% of all-time downloads
SvalTek/Gemma3-ColdBrew-Lorenz-12b-test1
Gemma3-ColdBrew-Lorenz-12b-test1 is a text generation model from SvalTek. Use it when you need the model to write or continue text. It is set up for transformers.
This is a merge of pre-trained language models created using mergekit.
Downloads · 30 days
11
15% of all-time downloads
All-time downloads
74
Public
Parameters
11.8B
23.6 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors23.5 GB · 100%
From the Hugging Face model README
This is a merge of pre-trained language models created using mergekit.
This model was merged using the DELLA merge method using ToastyPigeon/Gemma-3-Starshine-12B-Alt as a base.
The following models were included in the merge:
The following YAML configuration was used to produce this model:
name: Gemma3-ColdBrew-Lorenz-12b-test1
models:
- model: SvalTek/Gemma3-ColdBrew-Lorenz
parameters:
weight: 0.7
density: 0.6 # Lower density: more aggressive filtering
epsilon: 0.18 # High epsilon: only the most relevant changes are kept
- model: ToastyPigeon/g3-12b-storyteller-v0.2-textonly
parameters:
weight: 0.3
density: 0.75 # Higher density: more skill retained
epsilon: 0.08 # Lower epsilon: keep broader range of changes
base_model: ToastyPigeon/Gemma-3-Starshine-12B-Alt
merge_method: della
parameters:
lambda: 1.0
normalize: true
int8_mask: true
dtype: bfloat16
tokenizer:
source: union