Downloads · 30 days
0
Llama-3.2-1B-Instruct-QNN-HTP-Z4
zededa/Llama-3.2-1B-Instruct-QNN-HTP-Z4
Llama-3.2-1B-Instruct-QNN-HTP-Z4 is a machine learning model from zededa. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for qualcomm-ai-runtime. The card lists the license as llama3.2.
Pre-compiled model binary for Qualcomm Hexagon HTP NPU inference using QNN GenAI Transformer backend.
Access
Public
Updated Apr 7, 2026
Repo size
1.7 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin1.7 GB · 99%
At a glance
- Library
- qualcomm-ai-runtime
- License
- llama3.2
- Access
- Public
- Created
- Apr 7, 2026
- Updated
- Apr 7, 2026
- SHA
- c6af05b6
Base models
Model card
From the Hugging Face model README
Llama 3.2 1B Instruct - QNN HTP Z4 Quantized
Pre-compiled model binary for Qualcomm Hexagon HTP NPU inference using QNN GenAI Transformer backend.
Model Details
| Property | Value |
|---|---|
| Base Model | meta-llama/Llama-3.2-1B-Instruct |
| Quantization | Z4 (Qualcomm 4-bit) |
| Format | QNN GenAI Transformer single binary |
| SDK Version | QAIRT v2.38.0.250901 |
| Target Hardware | Qualcomm Hexagon HTP v73+ NPU |
| Binary Size | ~1.6 GB |
| Tensors | 147 (Z4 for weights, F32 for norms) |
Tested Hardware
- Qualcomm IQ-9075 EVK (QCS9075 SoC, Hexagon HTP v73)
Usage
This binary is designed for use with the Qualcomm Genie runtime (libGenie.so) or genie-t2t-run CLI.
With genie-t2t-run
cd /path/to/model/
LD_LIBRARY_PATH=/path/to/qnn-libs:/usr/lib \
ADSP_LIBRARY_PATH="/usr/lib/dsp/cdsp;/usr/lib/dsp/cdsp1" \
genie-t2t-run -c genie_config.json -p "Hello, how are you?"
genie_config.json
{
"dialog": {
"backend": "QnnGenAiTransformer",
"model-path": "llama3.2-1b-instruct-z4.bin",
"tokenizer": "tokenizer.json"
}
}
Compilation
Compiled using QAIRT SDK v2.38.0 GenAI Transformer Composer:
- Source:
meta-llama/Llama-3.2-1B-Instruct(HuggingFace) - Quantization: Z4 (4-bit weights, F32 normalization layers)
- Compile time: ~0.3 minutes on x86_64
License
This model inherits the Llama 3.2 Community License.
- Library
- qualcomm-ai-runtime
- License
- llama3.2
- Created
- Apr 7, 2026
- Updated
- Apr 7, 2026