Downloads · 30 days
5
9% of all-time downloads
Statuo/Qwen2.5-32b-Tatewaki-Kunou-EXL2-4bpw
Qwen2.5-32b-Tatewaki-Kunou-EXL2-4bpw is a text generation model from Statuo. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
Wanted to take a stab at this so I quanted it, but only the 6bpw and 4bpw quants.
Downloads · 30 days
5
9% of all-time downloads
All-time downloads
55
Public
Repo size
17.8 GB
Likes
0
Public
Click a slice to open those files.
.safetensors17.8 GB · 100%
From the Hugging Face model README
Wanted to take a stab at this so I quanted it, but only the 6bpw and 4bpw quants.
This is the EXL2 4bpw version of this model. For the original model, go here <br> For the 6bpw version, go here <br>
This is a merge of pre-trained language models created using mergekit.

The Blue Thunder
This model was merged using the TIES merge method using Sao10K/32B-Qwen2.5-Kunou-v1 as a base.
The following models were included in the merge:
The following YAML configuration was used to produce this model:
models:
- model: nbeerbower/Qwen2.5-Gutenberg-Doppel-32B
parameters:
density: 0.75
weight: 0.75
- model: EVA-UNIT-01/EVA-Qwen2.5-32B-v0.2
parameters:
density: 0.5
weight: 0.5
- model: Sao10K/32B-Qwen2.5-Kunou-v1
parameters:
density: 0.8
weight: 1
- model: Rombo-Org/Rombo-LLM-V2.5-Qwen-32b
parameters:
density: 0.5
weight: 0.5
merge_method: ties
base_model: Sao10K/32B-Qwen2.5-Kunou-v1
parameters:
normalize: false
int8_mask: true
dtype: float16