Downloads · 30 days
7
13% of all-time downloads
bdbj/Qwen2.5-7B-qpal-df-msq-4bit
Qwen2.5-7B-qpal-df-msq-4bit is a machine learning model from bdbj. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
- Base model: Qwen/Qwen2.5-7B - Quantization method: Memory constrained MSQ with Q-Palette - Target bit-width: 4 - Backend kernel: Q-Palette kernel - Calibration data: N/A (data-free)
Downloads · 30 days
7
13% of all-time downloads
All-time downloads
53
Public
Parameters
2.7B
5.5 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors5.5 GB · 100%
How the weights are stored.
I161.6B · 60%
From the Hugging Face model README
Qwen/Qwen2.5-7B