Downloads · 30 days
49
28% of all-time downloads
jrc2139/granite-embedding-reranker-english-r2-ONNX
granite-embedding-reranker-english-r2-ONNX is a text classification model from jrc2139. Use it when you need a label for a piece of text. It is set up for sentence-transformers.
This repository contains ONNX export and multiple quantized versions of ibm-granite/granite-embedding-reranker-english-r2.
Downloads · 30 days
49
28% of all-time downloads
All-time downloads
173
Public
Repo size
2.3 GB
Likes
0
Public
Click a slice to open those files.
.onnx1.4 GB · 100%
From the Hugging Face model README
This repository contains ONNX export and multiple quantized versions of ibm-granite/granite-embedding-reranker-english-r2.
from sentence_transformers import CrossEncoder
# Load Int8 model (ARM64 example)
model = CrossEncoder(
"jrc2139/granite-embedding-reranker-english-r2-onnx",
backend="onnx",
model_kwargs={"file_name": "onnx/model_qint8_arm64.onnx"},
trust_remote_code=True
)
scores = model.predict([("Query", "Document")])