Downloads · 30 days
4
16% of all-time downloads
Llama-3.1-70B-qpal-df-msq-3.4bit
bdbj/Llama-3.1-70B-qpal-df-msq-3.4bit
Llama-3.1-70B-qpal-df-msq-3.4bit is a machine learning model from bdbj. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as llama3.1.
- Base model: meta-llama/Llama-3.1-70B - Quantization method: Memory constrained MSQ with Q-Palette - Target bit-width: 3.4 - Backend kernel: Q-Palette kernel - Calibration data: N/A (data-free)
All-time downloads
25
Public
Parameters
16.4B
33.4 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors33.3 GB · 100%
Parameter types
How the weights are stored.
I1614.1B · 86%
Base models
Model card
From the Hugging Face model README
Model Card
- Base model:
meta-llama/Llama-3.1-70B - Quantization method: Memory constrained MSQ with Q-Palette
- Target bit-width: 3.4
- Backend kernel: Q-Palette kernel
- Calibration data: N/A (data-free)
How to run
- Follow the instruction in https://github.com/snu-mllab/Q-Palette.
References
- Type
- llama
- License
- llama3.1
- Created
- Nov 13, 2025
- Updated
- Nov 13, 2025