Qwen3-Embedding-4B-GGUF-Q4_K_M

majentik/Qwen3-Embedding-4B-GGUF-Q4_K_M

Qwen3-Embedding-4B-GGUF-Q4_K_M is a feature extraction model from majentik. Use it when you need embeddings to search or compare text. It is set up for gguf. The card lists the license as apache-2.0.

llama.cpp GGUF Q4KM quantization of Qwen/Qwen3-Embedding-4B.

Downloads · 30 days

7% of all-time downloads

All-time downloads

554

Public

Repo size

2.5 GB

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.gguf2.5 GB · 100%

At a glance

Task: Feature Extraction
Library: gguf
License: apache-2.0
Access: Public
Created: Apr 17, 2026
Updated: Jul 20, 2026
SHA: 6ab5c660

Base models

Qwen/Qwen3-Embedding-4B

Model card

From the Hugging Face model README

Qwen3-Embedding-4B GGUF Q4_K_M

llama.cpp GGUF Q4_K_M quantization of Qwen/Qwen3-Embedding-4B.

Produced with: llama-quantize (upstream llama.cpp, April 2026 build)
BF16 source converted via convert_hf_to_gguf.py from the fresh llama.cpp tree
Quant type: Q4_K_M
File size: 2.3 GB

Quickstart

llama-embedding -m qwen3-emb-4b-Q4_K_M.gguf \
  -p "What is the capital of France?"

Or via llama-cpp-python:

from llama_cpp import Llama
llm = Llama(model_path="qwen3-emb-4b-Q4_K_M.gguf", embedding=True)
vec = llm.embed("What is the capital of France?")

License

Apache 2.0 — inherited from the upstream base model.