Downloads · 30 days
5
7% of all-time downloads
QwQ-32B_exl2_4.0bpw
Dracones/QwQ-32B_exl2_4.0bpw
QwQ-32B_exl2_4.0bpw is a text generation model from Dracones. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This is a 4.0bpw EXL2 quant of Qwen/QwQ-32B
All-time downloads
76
Public
Repo size
17.8 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors17.8 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- qwen2
- Access
- Public
- Created
- Mar 6, 2025
- Updated
- Mar 6, 2025
- SHA
- 8c17ecfd
Try a prompt
Base models
Model card
From the Hugging Face model README
QwQ-32B - EXL2 4.0bpw
This is a 4.0bpw EXL2 quant of Qwen/QwQ-32B
Details about the model can be found at the above model page.
Perplexity Scoring
Below are the perplexity scores for the EXL2 models. A lower score is better.
| Quant Level | Perplexity Score |
|---|---|
| 8.0 | 6.4393 |
| 7.0 | 6.4452 |
| 6.0 | 6.4693 |
| 5.0 | 6.4732 |
| 4.5 | 6.5417 |
| 4.0 | 6.6190 |
- Task
- Text Generation
- Library
- transformers
- Type
- qwen2
- License
- apache-2.0
- Languages
- en
- Created
- Mar 6, 2025
- Updated
- Mar 6, 2025