Qwen3-Embedding-4B-GGUF-Q5_K_M

majentik/Qwen3-Embedding-4B-GGUF-Q5_K_M

Qwen3-Embedding-4B-GGUF-Q5_K_M is a feature extraction model from majentik. Use it when you need embeddings to search or compare text. It is set up for gguf. The card lists the license as apache-2.0.

llama.cpp GGUF Q5KM quantization of Qwen/Qwen3-Embedding-4B.

Downloads · 30 days

9% of all-time downloads

All-time downloads

551

Public

Repo size

2.9 GB

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.gguf2.9 GB · 100%

At a glance

Task: Feature Extraction
Library: gguf
License: apache-2.0
Access: Public
Created: Apr 17, 2026
Updated: Jul 20, 2026
SHA: 456a9ff0

Base models

Qwen/Qwen3-Embedding-4B

Model card

From the Hugging Face model README

Qwen3-Embedding-4B GGUF Q5_K_M

llama.cpp GGUF Q5_K_M quantization of Qwen/Qwen3-Embedding-4B.

Produced with: llama-quantize (upstream llama.cpp, April 2026 build)
BF16 source converted via convert_hf_to_gguf.py from the fresh llama.cpp tree
Quant type: Q5_K_M
File size: 2.7 GB

Quickstart

llama-embedding -m qwen3-emb-4b-Q5_K_M.gguf \
  -p "What is the capital of France?"

Or via llama-cpp-python:

from llama_cpp import Llama
llm = Llama(model_path="qwen3-emb-4b-Q5_K_M.gguf", embedding=True)
vec = llm.embed("What is the capital of France?")

License

Apache 2.0 — inherited from the upstream base model.