Qwen_Qwen3-4B-GGUF

Alcoft/Qwen_Qwen3-4B-GGUF

Qwen_Qwen3-4B-GGUF is a text generation model from Alcoft. Use it when you need the model to write or continue text.

Downloads · 30 days

29% of all-time downloads

All-time downloads

10.4K

Public

Repo size

74.8 GB

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.gguf74.8 GB · 100%

At a glance

Task: Text Generation
Access: Public
Created: Aug 11, 2025
Updated: Aug 11, 2025
SHA: 2695e627

Try a prompt

Base models

Qwen/Qwen3-4B

Model card

From the Hugging Face model README

Quant	Size	Description
Q2_K	1.55 GB	Not recommended for most people. Very low quality.
Q2_K_L	1.64 GB	Not recommended for most people. Uses Q8_0 for output and embedding, and Q2_K for everything else. Very low quality.
Q2_K_XL	1.98 GB	Not recommended for most people. Uses F16 for output and embedding, and Q2_K for everything else. Very low quality.
Q3_K_S	1.76 GB	Not recommended for most people. Prefer any bigger Q3_K quantization. Low quality.
Q3_K_M	1.93 GB	Not recommended for most people. Low quality.
Q3_K_L	2.09 GB	Not recommended for most people. Low quality.
Q3_K_XL	2.17 GB	Not recommended for most people. Uses Q8_0 for output and embedding, and Q3_K_L for everything else. Low quality.
Q3_K_XXL	2.51 GB	Not recommended for most people. Uses F16 for output and embedding, and Q3_K_L for everything else. Low quality.
Q4_K_S	2.22 GB	Recommended. Slightly low quality.
Q4_K_M	2.33 GB	Recommended. Decent quality for most use cases.
Q4_K_L	2.41 GB	Recommended. Uses Q8_0 for output and embedding, and Q4_K_M for everything else. Decent quality.
Q4_K_XL	2.75 GB	Recommended. Uses F16 for output and embedding, and Q4_K_M for everything else. Decent quality.
Q5_K_S	2.63 GB	Recommended. High quality.
Q5_K_M	2.69 GB	Recommended. High quality.
Q5_K_L	2.78 GB	Recommended. Uses Q8_0 for output and embedding, and Q5_K_M for everything else. High quality.
Q5_K_XL	3.12 GB	Recommended. Uses F16 for output and embedding, and Q5_K_M for everything else. High quality.
Q6_K	3.08 GB	Recommended. Very high quality.
Q6_K_L	3.17 GB	Recommended. Uses Q8_0 for output and embedding, and Q6_K for everything else. Very high quality.
Q6_K_XL	3.51 GB	Recommended. Uses F16 for output and embedding, and Q6_K for everything else. Very high quality.
Q8_0	3.99 GB	Recommended. Quality almost like F16.
Q8_K_XL	4.33 GB	Recommended. Uses F16 for output and embedding, and Q8_0 for everything else. Quality almost like F16.
F16	7.5 GB	Not recommended. Overkill. Prefer Q8_0.
ORIGINAL (BF16)	7.5 GB	Not recommended. Overkill. Prefer Q8_0.

Quantized using TAO71-AI AutoQuantizer. You can check out the original model card here.

Task: Text Generation
Created: Aug 11, 2025
Updated: Aug 11, 2025