Downloads · 30 days
7
11% of all-time downloads
QwQ-32B-Preview_exl2_6.0bpw
Dracones/QwQ-32B-Preview_exl2_6.0bpw
QwQ-32B-Preview_exl2_6.0bpw is a text generation model from Dracones. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This is a 6.0bpw EXL2 quant of QwQ-32B-Preview
All-time downloads
61
Public
Repo size
25.6 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors25.6 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- qwen2
- Access
- Public
- Created
- Dec 3, 2024
- Updated
- Dec 3, 2024
- SHA
- a9e18d01
Try a prompt
Base models
Model card
From the Hugging Face model README
QwQ-32B-Preview - EXL2 6.0bpw
This is a 6.0bpw EXL2 quant of QwQ-32B-Preview
Details about the model can be found at the above model page.
EXL2 Version
These quants were made with exllamav2 version 0.2.4. Quants made on this version of EXL2 may not work on older versions of the exllamav2 library.
If you have problems loading these models, please update Text Generation WebUI to the latest version.
- Task
- Text Generation
- Library
- transformers
- Type
- qwen2
- License
- apache-2.0
- Languages
- en
- Created
- Dec 3, 2024
- Updated
- Dec 3, 2024