jina-embeddings-v5-text-small-classification-GGUF

jinaai/jina-embeddings-v5-text-small-classification-GGUF

jina-embeddings-v5-text-small-classification-GGUF is a text classification model from jinaai. Use it when you need a label for a piece of text. It is set up for llama.cpp. The card lists the license as cc-by-nc-4.0.

GGUF quantizations of jina-embeddings-v5-text-small-classification using llama.cpp. A 677M parameter multilingual embedding model quantized for efficient inference.

Downloads · 30 days

522

5% of all-time downloads

All-time downloads

10K

Public

Repo size

13 GB

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.gguf5.9 GB · 100%

At a glance

Task: Text Classification
Library: llama.cpp
License: cc-by-nc-4.0
Access: Public
Created: Feb 18, 2026
Updated: Feb 25, 2026
SHA: d7256766

Base models

jinaai/jina-embeddings-v5-text-small

Model card

From the Hugging Face model README

jina-embeddings-v5-text-small-classification-GGUF

GGUF quantizations of jina-embeddings-v5-text-small-classification using llama.cpp. A 677M parameter multilingual embedding model quantized for efficient inference.

Elastic Inference Service | ArXiv | Blog

[!IMPORTANT] We highly recommend to first read this blog post for more technical details and customized llama.cpp build.

Overview

jina-embeddings-v5-text-small-classification is a task-specific embedding model for classification, part of the jina-embeddings-v5-text model family.

Feature	Value
Parameters	677M
Task	`classification`
Embedding Dimension	1024
Matryoshka Dimensions	32, 64, 128, 256, 512, 768, 1024
Pooling Strategy	Last-token pooling
Base Model	jina-embeddings-v5-text-small

Usage with llama.cpp

<details open> <summary>via <a href="https://www.elastic.co/docs/explore-analyze/elastic-inference/eis">Elastic Inference Service</a></summary>

The fastest way to use v5-text in production. Elastic Inference Service (EIS) provides managed embedding inference with built-in scaling, so you can generate embeddings directly within your Elastic deployment.

PUT _inference/text_embedding/jina-v5
{
  "service": "elastic",
  "service_settings": {
    "model_id": "jina-embeddings-v5-text-small"
  }
}

See the Elastic Inference Service documentation for setup details.

</details>

# Build llama.cpp (upstream)
git clone https://github.com/ggml-org/llama.cpp
cd llama.cpp && cmake -B build && cmake --build build --config Release

# Run embedding
./build/bin/llama-embedding -m jina-embeddings-v5-text-small-classification-Q8_0.gguf \
  --pooling last -p "Your text here"

License

CC-BY-NC-4.0. For commercial use, please contact us.

Task: Text Classification
Library: llama.cpp
License: cc-by-nc-4.0
Languages: multilingual
Created: Feb 18, 2026
Updated: Feb 25, 2026