Downloads · 30 days
74
16% of all-time downloads
trithemius/granite-embedding-reranker-english-r2-GGUF
granite-embedding-reranker-english-r2-GGUF is a sentence similarity model from trithemius. Use it when you need a score for how close two texts are. It is set up for gguf. The card lists the license as apache-2.0.
GGUF F16 conversion of ibm-granite/granite-embedding-reranker-english-r2.
Downloads · 30 days
74
16% of all-time downloads
All-time downloads
450
Public
Repo size
901 MB
Likes
0
Public
Click a slice to open those files.
.gguf901 MB · 100%
From the Hugging Face model README
GGUF F16 conversion of ibm-granite/granite-embedding-reranker-english-r2.
This repository provides an F16 GGUF export of the original IBM Granite English reranker / embedding model for use in GGUF-compatible tooling where supported.
ibm-granite/granite-embedding-reranker-english-r2This repository is a format conversion of the original model.
Please refer to the original model card for authoritative details on training data, intended uses, limitations, and evaluation.
granite-embedding-reranker-english-r2-f16.gguf — GGUF model in full F16 precisionibm-granite/granite-embedding-reranker-english-r2YOUR_USERNAMEllama.cpp / convert_hf_to_gguf.pyThis model is intended for embedding / reranking tasks, subject to support in the target runtime.
Typical use cases may include:
This is not a generative chat model. It is a converted reranker / embedding-style model.
GGUF is most commonly used with runtimes centered around LLM inference.
Support for encoder-style, embedding, or reranker architectures may vary depending on the runtime and version.
Before using this file, verify that your target GGUF runtime supports:
Using huggingface-cli:
huggingface-cli download YOUR_USERNAME/granite-embedding-reranker-english-r2-GGUF \
granite-embedding-reranker-english-r2-f16.gguf \
--local-dir .