Downloads · 30 days
6.4K
19% of all-time downloads
jinaai/jina-embeddings-v5-text-nano-retrieval-GGUF
jina-embeddings-v5-text-nano-retrieval-GGUF is a sentence similarity model from jinaai. Use it when you need a score for how close two texts are. It is set up for llama.cpp. The card lists the license as cc-by-nc-4.0.
GGUF quantizations of jina-embeddings-v5-text-nano-retrieval using llama.cpp. A 239M parameter multilingual embedding model quantized for efficient inference.
Downloads · 30 days
6.4K
19% of all-time downloads
All-time downloads
33.6K
Public
Repo size
5.1 GB
Likes
4
Trending 1
Click a slice to open those files.
.gguf2.3 GB · 100%
From the Hugging Face model README
GGUF quantizations of jina-embeddings-v5-text-nano-retrieval using llama.cpp. A 239M parameter multilingual embedding model quantized for efficient inference.
Elastic Inference Service | ArXiv | Blog
[!IMPORTANT] We highly recommend to first read this blog post for more technical details and customized llama.cpp build.
jina-embeddings-v5-text-nano-retrieval is a task-specific embedding model for retrieval, part of the jina-embeddings-v5-text model family.
| Feature | Value |
|---|---|
| Parameters | 239M |
| Task | retrieval |
| Embedding Dimension | 768 |
| Matryoshka Dimensions | 32, 64, 128, 256, 512, 768 |
| Pooling Strategy | Last-token pooling |
| Base Model | jina-embeddings-v5-text-nano |
The fastest way to use v5-text in production. Elastic Inference Service (EIS) provides managed embedding inference with built-in scaling, so you can generate embeddings directly within your Elastic deployment.
PUT _inference/text_embedding/jina-v5
{
"service": "elastic",
"service_settings": {
"model_id": "jina-embeddings-v5-text-nano"
}
}
See the Elastic Inference Service documentation for setup details.
</details># Build llama.cpp (upstream)
git clone https://github.com/ggml-org/llama.cpp
cd llama.cpp && cmake -B build && cmake --build build --config Release
# Run embedding
./build/bin/llama-embedding -m jina-embeddings-v5-text-nano-retrieval-Q8_0.gguf \
--pooling last -p "Your text here"
CC-BY-NC-4.0. For commercial use, please contact us.