Downloads ยท 30 days
511
12% of all-time downloads
leeminwaan/Qwen3-MOE-4x0.6B-2.4B-reasoning-v1-full-GGUF
Qwen3-MOE-4x0.6B-2.4B-reasoning-v1-full-GGUF is a text generation model from leeminwaan. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
This repo is packed with multiple quantized versions of leeminwaan/Qwen3-MOE-4x0.6B-2.4B-reasoning-v1-full in GGUF format. ๐โจ Built for running efficiently on your everyday hardware - no need for enterprise-level speโฆ
Downloads ยท 30 days
511
12% of all-time downloads
All-time downloads
4.2K
Public
Repo size
12.9 GB
Likes
4
Public
Click a slice to open those files.
.gguf12.9 GB ยท 100%
From the Hugging Face model README
This repo is packed with multiple quantized versions of leeminwaan/Qwen3-MOE-4x0.6B-2.4B-reasoning-v1-full in GGUF format. ๐โจ
Built for running efficiently on your everyday hardware - no need for enterprise-level specs to deploy these models. ๐ป๐ฏ๐ฅ
| Quantization | Size (vs. FP16) | Speed | Quality | Recommended For |
|---|---|---|---|---|
| Q2_K | Tiny ๐ญ | Lightning โก | Basic ๐ | Quick prototypes, potato hardware ๐งช |
| Q3_K_S | Mini ๐น | Super fast ๐ | Decent ๐ | Mobile devices, quick tests ๐ฑ |
| Q3_K_M | Small ๐ฐ | Fast ๐จ | Good ๐ | Lightweight but better quality |
| Q3_K_L | Small+ ๐ฑ | Fast โก | Good ๐ | Speed with acceptable quality |
| Q4_0 | Medium ๐บ | Quick โก | Solid ๐ | Daily driver, casual chats ๐ฌ |
| Q4_1 | Medium ๐ฆ | Quick ๐ | Solid+ ๐ | Slight upgrade from Q4_0 |
| Q4_K_S | Medium ๐ป | Quick ๐จ | Nice โจ | Well-balanced choice โ๏ธ |
| Q4_K_M | Medium ๐ฆ | Quick โก | Really nice ๐ | The crowd favorite ๐ |
| Q5_0 | Chunky ๐ | Chill ๐ถ | Great ๐ช | Chatbots that actually make sense ๐ค |
| Q5_1 | Chunky ๐ฆ | Chill โณ | Great+ ๐ฅ | When you need quality responses ๐ผ |
| Q5_K_S | Big ๐ณ | Chill ๐ | Great+ โญ | For the quality-conscious ๐ฏ |
| Q5_K_M | Big ๐ฆฃ | Chill โ | Excellent ๐ | High-end performance ๐ |
| Q6_K | Massive ๐ | Slow ๐ | Near perfect ๐ | Enthusiasts only |
| Q8_0 | Absolute unit ๐ฆ | Turtle ๐ข | Basically perfect ๐ | Max settings gang ๐ฅ๏ธ |
๐ Real talk:
- Lower numbers = smaller files ๐, runs faster โก, but quality takes a hit ๐
- Q4_K_M hits different - it's the sweet spot most people actually want ๐ฅ
- Q6_K/Q8_0 are for perfectionists with beefy hardware ๐๐งโโ๏ธ
- Everything here runs on regular consumer hardware ๐ป - pick what matches your vibe! ๐ฏ
# ๐ Quick start - literally just this:
from huggingface_hub import hf_hub_download
# ๐ฅ Grab the model (Q4_K_M is the sweet spot for most people)
model_path = hf_hub_download("leeminwaan/Qwen3-MOE-4x0.6B-2.4B-reasoning-v1-full-GGUF", "Qwen3-MOE-4x0.6B-2.4B-reasoning-v1-full-q4_k_m.gguf")
print("Downloaded:", model_path) # ๐ You're good to go!
Available flavors: ๐๐ฆ
BibTeX: ๐๐ฌ
@miscQwen3-MOE-4x0.6B-2.4B-reasoning-v1-full-GGUF,
title=Qwen3-MOE-4x0.6B-2.4B-reasoning-v1-full-GGUF Quantized Models},
author={leeminwaan},
year={2025}, % ๐ Hot off the press!
howpublished={\url{https://huggingface.co/leeminwaan/Qwen3-MOE-4x0.6B-2.4B-reasoning-v1-full-GGUF}}
}
APA: ๐โจ
leeminwaan. (2025). Qwen3-MOE-4x0.6B-2.4B-reasoning-v1-full-GGUF Quantized Models [Computer software]. ๐ป Hugging Face. https://huggingface.co/leeminwaan/Qwen3-MOE-4x0.6B-2.4B-reasoning-v1-full-GGUF ๐ค