Downloads · 30 days
4
3% of all-time downloads
jrc2139/granite-embedding-english-r2-ONNX
granite-embedding-english-r2-ONNX is a feature extraction model from jrc2139. Use it when you need embeddings to search or compare text. It is set up for sentence-transformers.
This repository contains ONNX export and multiple quantized versions of ibm-granite/granite-embedding-english-r2.
Downloads · 30 days
4
3% of all-time downloads
All-time downloads
135
Public
Repo size
1.9 GB
Likes
1
Public
Click a slice to open those files.
.onnx1.4 GB · 100%
From the Hugging Face model README
This repository contains ONNX export and multiple quantized versions of ibm-granite/granite-embedding-english-r2.
from sentence_transformers import SentenceTransformer
# Load Int8 model (ARM64 example)
model = SentenceTransformer(
"jrc2139/granite-embedding-english-r2-ONNX",
backend="onnx",
model_kwargs={"file_name": "onnx/model_qint8_arm64.onnx"},
trust_remote_code=True
)