Qwen3-Embedding-4B-GGUF-Q8_0

majentik/Qwen3-Embedding-4B-GGUF-Q8_0

Qwen3-Embedding-4B-GGUF-Q8_0 is a feature extraction model from majentik. Use it when you need embeddings to search or compare text. It is set up for gguf. The card lists the license as apache-2.0.

llama.cpp GGUF Q80 quantization of Qwen/Qwen3-Embedding-4B.

Downloads · 30 days

6% of all-time downloads

All-time downloads

1.3K

Public

Repo size

4.3 GB

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.gguf4.3 GB · 100%

At a glance

Task: Feature Extraction
Library: gguf
License: apache-2.0
Access: Public
Created: Apr 17, 2026
Updated: Jul 20, 2026
SHA: 567bc055

Base models

Qwen/Qwen3-Embedding-4B

Model card

From the Hugging Face model README

Qwen3-Embedding-4B GGUF Q8_0

llama.cpp GGUF Q8_0 quantization of Qwen/Qwen3-Embedding-4B.

Produced with: llama-quantize (upstream llama.cpp, April 2026 build)
BF16 source converted via convert_hf_to_gguf.py from the fresh llama.cpp tree
Quant type: Q8_0
File size: 4.0 GB

Quickstart

llama-embedding -m qwen3-emb-4b-Q8_0.gguf \
  -p "What is the capital of France?"

Or via llama-cpp-python:

from llama_cpp import Llama
llm = Llama(model_path="qwen3-emb-4b-Q8_0.gguf", embedding=True)
vec = llm.embed("What is the capital of France?")

License

Apache 2.0 — inherited from the upstream base model.