Downloads · 30 days
5
12% of all-time downloads
Qwen-QwQ-32B-4.0bpw-exl2
cshared/Qwen-QwQ-32B-4.0bpw-exl2
Qwen-QwQ-32B-4.0bpw-exl2 is a text generation model from cshared. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
Disclaimer: I don't know what I'm doing.
All-time downloads
43
Public
Repo size
17.8 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors17.8 GB · 100%
At a glance
- Task
- Text Generation
- License
- apache-2.0
- Model type
- qwen2
- Access
- Public
- Created
- Mar 6, 2025
- Updated
- Mar 6, 2025
- SHA
- f7ee4d77
Try a prompt
Base models
Model card
From the Hugging Face model README
Disclaimer: I don't know what I'm doing.
Original Model: https://huggingface.co/Qwen/QwQ-32B
| QwQ 32B EXL2 | Size |
|---|---|
| <a href="https://huggingface.co/cshared/Qwen-QwQ-32B-8.0bpw-exl2">8.0bpw</a> | 33.5 GB |
| <a href="https://huggingface.co/cshared/Qwen-QwQ-32B-7.0bpw-exl2">7.0bpw</a> | 29.6 GB |
| <a href="https://huggingface.co/cshared/Qwen-QwQ-32B-6.5bpw-exl2">6.5bpw</a> | 27.5 GB |
| <a href="https://huggingface.co/cshared/Qwen-QwQ-32B-6.0bpw-exl2">6.0bpw</a> | 25.6 GB |
| <a href="https://huggingface.co/cshared/Qwen-QwQ-32B-5.5bpw-exl2">5.5bpw</a> | 23.6 GB |
| <a href="https://huggingface.co/cshared/Qwen-QwQ-32B-5.0bpw-exl2">5.0bpw</a> | 21.7 GB |
| <a href="https://huggingface.co/cshared/Qwen-QwQ-32B-4.5bpw-exl2">4.5bpw</a> | 19.7 GB |
| <a href="https://huggingface.co/cshared/Qwen-QwQ-32B-4.0bpw-exl2">4.0bpw</a> | 17.8 GB |
| <a href="https://huggingface.co/cshared/Qwen-QwQ-32B-3.75bpw-exl2">3.75bpw</a> | 16.8 GB |
| WIP |
- Task
- Text Generation
- Type
- qwen2
- License
- apache-2.0
- Created
- Mar 6, 2025
- Updated
- Mar 6, 2025