Downloads · 30 days
3
3% of all-time downloads
jrc2139/granite-embedding-small-english-r2-ONNX
granite-embedding-small-english-r2-ONNX is a feature extraction model from jrc2139. Use it when you need embeddings to search or compare text. It is set up for sentence-transformers.
This repository contains ONNX export and multiple quantized versions of ibm-granite/granite-embedding-small-english-r2.
Downloads · 30 days
3
3% of all-time downloads
All-time downloads
110
Public
Repo size
1.3 GB
Likes
0
Public
Click a slice to open those files.
.onnx480 MB · 99%
From the Hugging Face model README
This repository contains ONNX export and multiple quantized versions of ibm-granite/granite-embedding-small-english-r2.
from sentence_transformers import SentenceTransformer
# Load Int8 model (ARM64 example)
model = SentenceTransformer(
"jrc2139/granite-embedding-small-english-r2-ONNX",
backend="onnx",
model_kwargs={"file_name": "onnx/model_qint8_arm64.onnx"},
trust_remote_code=True
)