Downloads · 30 days
9
24% of all-time downloads
bdbj/Llama-2-13b-qpal-hess-msq-2bit
Llama-2-13b-qpal-hess-msq-2bit is a machine learning model from bdbj. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as llama2.
- Base model: meta-llama/Llama-2-13b-hf - Quantization method: Memory constrained MSQ with Q-Palette - Target bit-width: 2 - Backend kernel: Q-Palette kernel - Calibration data: RedPajama (Hessian)
Downloads · 30 days
9
24% of all-time downloads
All-time downloads
37
Public
Parameters
1.9B
3.8 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors3.8 GB · 100%
How the weights are stored.
I161.6B · 83%
From the Hugging Face model README
meta-llama/Llama-2-13b-hf