Downloads · 30 days
5
24% of all-time downloads
Qwen2.5-32B-Instruct-bnb-4bit
lierseleow/Qwen2.5-32B-Instruct-bnb-4bit
Qwen2.5-32B-Instruct-bnb-4bit is a machine learning model from lierseleow. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
This repository contains quantized weights for Qwen/Qwen2.5-32B-Instruct.
All-time downloads
21
Public
Parameters
32.8B
19.2 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors19.2 GB · 100%
Parameter types
How the weights are stored.
U831.2B · 95%
Base models
Model card
From the Hugging Face model README
lierseleow/Qwen2.5-32B-Instruct-bnb-4bit (Quantized)
This repository contains quantized weights for Qwen/Qwen2.5-32B-Instruct.
License & Attribution
Built with Alibaba Cloud Qwen 2.5.
This model is a derivative work of Alibaba Clouds's Qwen 2.5 and is governed by the Apache 2.0 License and the Qwen Usage Policy.
- Official License: Apache 2.0 License
- Usage Policy: Qwen Usage Policy
By downloading, copying, or using these quantized weights, you agree to compliance with the terms, conditions, and restrictions outlined.
Quantization Details
- Quantization Method: bitsandbytes
- Bits/Precision: 4bit
- Base Model: Qwen/Qwen2.5-32B-Instruct
Dependencies Details
- transformers version: 5.14.1
- bitsandbytes version: 0.50.0
- Type
- qwen2
- License
- apache-2.0
- Created
- Aug 25, 2026
- Updated
- Aug 25, 2026