Downloads · 30 days
7
19% of all-time downloads
bdbj/Llama-2-7b-qpal-hess-msq-2bit
Llama-2-7b-qpal-hess-msq-2bit is a machine learning model from bdbj. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as llama2.
- Base model: meta-llama/Llama-2-7b-hf - Quantization method: Memory constrained MSQ with Q-Palette - Target bit-width: 2 - Backend kernel: Q-Palette kernel - Calibration data: RedPajama (Hessian)
Downloads · 30 days
7
19% of all-time downloads
All-time downloads
36
Public
Parameters
1.1B
2.2 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors2.2 GB · 100%
How the weights are stored.
I16809M · 75%
From the Hugging Face model README
meta-llama/Llama-2-7b-hf