Downloads · 30 days
19
8% of all-time downloads
SvalTek/SOR-ColdBrew-12B-Base-Test3
SOR-ColdBrew-12B-Base-Test3 is a text generation model from SvalTek. Use it when you need the model to write or continue text. It is set up for transformers.
This is a merge of pre-trained language models created using mergekit.
Downloads · 30 days
19
8% of all-time downloads
All-time downloads
234
Public
Parameters
12.2B
24.5 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors24.5 GB · 100%
From the Hugging Face model README
This is a merge of pre-trained language models created using mergekit.
The following YAML configuration was used to produce this model:
name: SOR-ColdBrew-12B-Base-Test3
models:
- model: TheDrunkenSnail/Son-of-Rhodia
parameters:
weight: 0.4
- model: SvalTek/SOR-ColdBrew-12B-Base-Testing
parameters:
weight: 0.6
base_model: redrix/GodSlayer-12B-ABYSS
merge_method: nuslerp
dtype: bfloat16
chat_template: "chatml"
tokenizer:
source: union
parameters:
normalize: true
int8_mask: true