Downloads · 30 days
20
10% of all-time downloads
QwQ-32B-bnb-4bit
kaitchup/QwQ-32B-bnb-4bit
QwQ-32B-bnb-4bit is a text generation model from kaitchup. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This is Qwen/QwQ-32B quantized with bitsandbytes in 4-bit. The model has been created, tested, and evaluated by The Kaitchup. The model is compatible with vLLM and Transformers.
All-time downloads
210
Public
Parameters
33.7B
19.2 GB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors19.2 GB · 100%
Parameter types
How the weights are stored.
U832.2B · 95%
Try a prompt
Base models
Model card
From the Hugging Face model README
Model Details
This is Qwen/QwQ-32B quantized with bitsandbytes in 4-bit. The model has been created, tested, and evaluated by The Kaitchup. The model is compatible with vLLM and Transformers.
Details on the quantization process and how to use the model here: The Kaitchup
- Developed by: The Kaitchup
- Language(s) (NLP): English
- License: Apache 2.0 license
How to Support My Work
Subscribe to The Kaitchup. This helps me a lot to continue quantizing and evaluating models for free.
- Task
- Text Generation
- Library
- transformers
- Type
- qwen2
- License
- apache-2.0
- Languages
- en
- Created
- Mar 6, 2025
- Updated
- Mar 7, 2025