Downloads · 30 days
6
6% of all-time downloads
Yanfei-v2-Qwen3-32B-exl3-4.5bpw-hb8
MetaphoricalCode/Yanfei-v2-Qwen3-32B-exl3-4.5bpw-hb8
Yanfei-v2-Qwen3-32B-exl3-4.5bpw-hb8 is a text generation model from MetaphoricalCode. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
- Original model: https://huggingface.co/nbeerbower/Yanfei-v2-Qwen3-32B - exllamav3: https://github.com/turboderp-org/exllamav3 ---
All-time downloads
93
Public
Parameters
10B
19.9 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors19.9 GB · 100%
Parameter types
How the weights are stored.
I169.2B · 92%
Try a prompt
Base models
Datasets
Model card
From the Hugging Face model README
Quantized using the default exllamav3 (0.0.3) quantization process.
- Original model: https://huggingface.co/nbeerbower/Yanfei-v2-Qwen3-32B
- exllamav3: https://github.com/turboderp-org/exllamav3
Yanfei-v2-Qwen3-32B
A repair of Yanfei-Qwen-32B by TIES merging huihui-ai/Qwen3-32B-abliterated, Zhiming-Qwen3-32B, and Menghua-Qwen3-32B using mergekit.
Sponsorship
This model was made possible with compute support from Nectar AI. Thank you! ❤️
Configuration
The following YAML configuration was used to produce this model:
models:
- model: ./Zhiming-Qwen3-32B-merged
parameters:
weight: 1
density: 1
- model: ./Menghua-Qwen3-32B-merged
parameters:
weight: 1
density: 1
- model: huihui-ai/Qwen3-32B-abliterated
parameters:
weight: 1
density: 1
merge_method: ties
base_model: nbeerbower/Yanfei-Qwen3-32B
parameters:
weight: 1
density: 1
normalize: true
int8_mask: true
dtype: bfloat16
- Task
- Text Generation
- Library
- transformers
- Type
- qwen3
- License
- apache-2.0
- Created
- Jun 11, 2025
- Updated
- Jun 11, 2025