Qwen3-Embedding-4B-GGUF-IQ4_XS

majentik/Qwen3-Embedding-4B-GGUF-IQ4_XS

Qwen3-Embedding-4B-GGUF-IQ4_XS is a feature extraction model from majentik. Use it when you need embeddings to search or compare text. It is set up for gguf. The card lists the license as apache-2.0.

llama.cpp GGUF IQ4XS quantization of Qwen/Qwen3-Embedding-4B.

Downloads · 30 days

4% of all-time downloads

All-time downloads

644

Public

Repo size

2.3 GB

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.gguf2.3 GB · 100%

At a glance

Task: Feature Extraction
Library: gguf
License: apache-2.0
Access: Public
Created: Apr 17, 2026
Updated: Jul 20, 2026
SHA: 7caaf05b

Base models

Qwen/Qwen3-Embedding-4B

Model card

From the Hugging Face model README

Qwen3-Embedding-4B GGUF IQ4_XS

llama.cpp GGUF IQ4_XS quantization of Qwen/Qwen3-Embedding-4B.

Produced with: llama-quantize (upstream llama.cpp, April 2026 build)
BF16 source converted via convert_hf_to_gguf.py from the fresh llama.cpp tree
Quant type: IQ4_XS
File size: 2.1 GB

Quickstart

llama-embedding -m qwen3-emb-4b-IQ4_XS.gguf \
  -p "What is the capital of France?"

Or via llama-cpp-python:

from llama_cpp import Llama
llm = Llama(model_path="qwen3-emb-4b-IQ4_XS.gguf", embedding=True)
vec = llm.embed("What is the capital of France?")

License

Apache 2.0 — inherited from the upstream base model.