Downloads · 30 days
3.5K
23% of all-time downloads
dnotitia_Smoothie-Qwen3-4B-GGUF
Alcoft/dnotitia_Smoothie-Qwen3-4B-GGUF
dnotitia_Smoothie-Qwen3-4B-GGUF is a text generation model from Alcoft. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
All-time downloads
15.4K
Public
Repo size
73.8 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf99.9 GB · 100%
At a glance
- Task
- Text Generation
- License
- apache-2.0
- Access
- Public
- Created
- Sep 10, 2025
- Updated
- Sep 10, 2025
- SHA
- dc8d2478
Try a prompt
Base models
Model card
From the Hugging Face model README
| Quant | Size | Description |
|---|---|---|
| Q2_K_XXS | 1.38 GB | Not recommended for most people. Extremelly low quality. |
| Q2_K_XS | 1.38 GB | Not recommended for most people. Very low quality. |
| Q2_K | 1.38 GB | Not recommended for most people. Very low quality. |
| Q2_K_L | 1.64 GB | Not recommended for most people. Uses Q8_0 for output and embedding, and Q2_K for everything else. Very low quality. |
| Q2_K_XL | 1.98 GB | Not recommended for most people. Uses F16 for output and embedding, and Q2_K for everything else. Very low quality. |
| Q3_K_XXS | 1.62 GB | Not recommended for most people. Prefer any bigger Q3_K quantization. Very low quality. |
| Q3_K_XS | 1.62 GB | Not recommended for most people. Prefer any bigger Q3_K quantization. Very low quality. |
| Q3_K_S | 1.62 GB | Not recommended for most people. Prefer any bigger Q3_K quantization. Low quality. |
| Q3_K_M | 1.79 GB | Not recommended for most people. Low quality. |
| Q3_K_L | 1.94 GB | Not recommended for most people. Low quality. |
| Q3_K_XL | 2.17 GB | Not recommended for most people. Uses Q8_0 for output and embedding, and Q3_K_L for everything else. Low quality. |
| Q3_K_XXL | 2.51 GB | Not recommended for most people. Uses F16 for output and embedding, and Q3_K_L for everything else. Low quality. |
| Q4_K_XS | 2.13 GB | Lower quality than Q4_K_S. |
| Q4_K_S | 2.13 GB | Recommended. Slightly low quality. |
| Q4_K_M | 2.23 GB | Recommended. Decent quality for most use cases. |
| Q4_K_L | 2.41 GB | Recommended. Uses Q8_0 for output and embedding, and Q4_K_M for everything else. Decent quality. |
| Q4_K_XL | 2.75 GB | Recommended. Uses F16 for output and embedding, and Q4_K_M for everything else. Decent quality. |
| Q5_K_XXS | 2.58 GB | Lower quality than Q5_K_S. |
| Q5_K_XS | 2.58 GB | Lower quality than Q5_K_S. |
| Q5_K_S | 2.58 GB | Recommended. High quality. |
| Q5_K_M | 2.64 GB | Recommended. High quality. |
| Q5_K_L | 2.78 GB | Recommended. Uses Q8_0 for output and embedding, and Q5_K_M for everything else. High quality. |
| Q5_K_XL | 3.12 GB | Recommended. Uses F16 for output and embedding, and Q5_K_M for everything else. High quality. |
| Q6_K_S | 3.08 GB | Lower quality than Q6_K. |
| Q6_K | 3.08 GB | Recommended. Very high quality. |
| Q6_K_L | 3.17 GB | Recommended. Uses Q8_0 for output and embedding, and Q6_K for everything else. Very high quality. |
| Q6_K_XL | 3.51 GB | Recommended. Uses F16 for output and embedding, and Q6_K for everything else. Very high quality. |
| Q8_K_XS | 3.99 GB | Lower quality than Q8_0. |
| Q8_K_S | 3.99 GB | Lower quality than Q8_0. |
| Q8_0 | 3.99 GB | Recommended. Quality almost like F16. |
| Q8_K_XL | 4.33 GB | Recommended. Uses F16 for output and embedding, and Q8_0 for everything else. Quality almost like F16. |
| F16 | 7.5 GB | Not recommended. Overkill. Prefer Q8_0. |
| ORIGINAL (BF16) | 7.5 GB | Not recommended. Overkill. Prefer Q8_0. |
Quantized using TAO71-AI AutoQuantizer. You can check out the original model card here.
- Task
- Text Generation
- License
- apache-2.0
- Languages
- en
- Created
- Sep 10, 2025
- Updated
- Sep 10, 2025