Downloads · 30 days
0
anthonypjshaw/harrier-oss-v1-0.6b-qnn-htp
harrier-oss-v1-0.6b-qnn-htp is a feature extraction model from anthonypjshaw. Use it when you need embeddings to search or compare text. It is set up for onnxruntime. The card lists the license as mit.
This is a static-INT8 (int8) quantized build of microsoft/harrier-oss-v1-0.6b, compiled by Qualcomm AI Hub to a precompiled QNN context binary wrapped in an ONNX file consumable by ONNX Runtime's QNN Execution Provide…
Downloads · 30 days
0
Access
Public
Updated May 18, 2026
Repo size
777 MB
Likes
0
Public
Click a slice to open those files.
.bin765 MB · 98%
From the Hugging Face model README
This is a static-INT8 (int8) quantized build of
microsoft/harrier-oss-v1-0.6b,
compiled by Qualcomm AI Hub to a precompiled QNN
context binary wrapped in an ONNX file consumable by ONNX Runtime's QNN
Execution Provider on Snapdragon X Elite (Hexagon HTP V81).
microsoft/harrier-oss-v1-0.6b
(1.2 GB safetensors).torch.jit.trace at static shape
(batch=1, seq_len=512). The traced module wraps the backbone with
masked mean pooling over the last hidden state and L2-normalises, so the
exported model behaves as a sentence encoder returning a unit-norm
embedding.submit_compile_job call with:
- --target_runtime precompiled_qnn_onnx
- --quantize_full_type int8 (static INT8 weights + activations)
- --truncate_64bit_io (HTP I/O is bounded to int32)
- calibration_data = 20 tokenized representative natural-language inputs
AI Hub internally performs PT -> ONNX conversion, PTQ, and HTP lowering for
Snapdragon X Elite CRD running OS 11.Because the conversion happens inside AI Hub's own translator, the resulting
ONNX graph uses only ai.onnx ops - none of the com.microsoft.* contrib ops
that the pre-fused onnx-community/harrier-oss-v1-0.6b-ONNX export contains -
so the graph reaches the Hexagon NPU end-to-end without CPU fallback.
| File | Purpose |
|---|---|
harrier-oss-v1-0.6b.qnn_ctx.onnx | ONNX wrapper containing the embedded QNN HTP context binary |
tokenizer.json | HF Tokenizers JSON (copied verbatim from the source repo) |
tokenizer_config.json, special_tokens_map.json | Tokenizer metadata |
aihub-metadata.txt | URLs of the AI Hub compile / profile jobs |
import * as ort from "onnxruntime-node";
const session = await ort.InferenceSession.create(
"harrier-oss-v1-0.6b.qnn_ctx.onnx",
{
executionProviders: [
{
name: "qnn",
backend_path: "QnnHtp.dll",
htp_performance_mode: "burst",
htp_graph_finalization_optimization_mode: "3",
},
],
graphOptimizationLevel: "all",
},
);
const inputIds = new BigInt64Array(512).fill(0n);
const attentionMask = new BigInt64Array(512).fill(1n);
const feeds = {
input_ids: new ort.Tensor("int64", inputIds, [1, 512]),
attention_mask: new ort.Tensor("int64", attentionMask, [1, 512]),
};
const { embedding } = await session.run(feeds);
512 tokens. Pad or truncate accordingly.MIT, inherited from
microsoft/harrier-oss-v1-0.6b.