Downloads · 30 days
183
48% of all-time downloads
vladlen32230/Saiga-llama3-L3-Stheno-8B-v3.2
Saiga-llama3-L3-Stheno-8B-v3.2 is a text generation model from vladlen32230. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
This is a merge of pre-trained language models created using mergekit.
Downloads · 30 days
183
48% of all-time downloads
All-time downloads
383
Public
Parameters
8B
16.1 GB on disk
Likes
1
Public
Click a slice to open those files.
.safetensors16.1 GB · 100%
From the Hugging Face model README
This is a merge of pre-trained language models created using mergekit.
This model was merged using the TIES merge method using ./L3-8B-Stheno-v3.2 as a base.
The following models were included in the merge:
The following YAML configuration was used to produce this model:
models:
- model: ./L3-8B-Stheno-v3.2 # Roleplay specialist
parameters:
weight: 0.6 # Slightly higher weight if RP is your priority
- model: ./saiga_llama3_8b # Russian language specialist
parameters:
weight: 0.4
merge_method: ties
base_model: ./L3-8B-Stheno-v3.2 # Use RP model as base
dtype: bfloat16 # Or float16 if bfloat16 isn't available
parameters:
normalize: true
density: 0.5 # Adjust based on your needs (0.3-0.6 works well)