Downloads · 30 days
7
21% of all-time downloads
bdbj/Qwen2.5-7B-qpal-df-msq-3.5bit
Qwen2.5-7B-qpal-df-msq-3.5bit is a machine learning model from bdbj. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
- Base model: Qwen/Qwen2.5-7B - Quantization method: Memory constrained MSQ with Q-Palette - Target bit-width: 3.5 - Backend kernel: Q-Palette kernel - Calibration data: N/A (data-free)
Downloads · 30 days
7
21% of all-time downloads
All-time downloads
34
Public
Parameters
2.5B
5.1 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors5 GB · 100%
How the weights are stored.
I161.4B · 57%
From the Hugging Face model README
Qwen/Qwen2.5-7B