Downloads · 30 days
125
22% of all-time downloads
qwen-0.5b-gguf
mohdnahidmondol/qwen-0.5b-gguf
qwen-0.5b-gguf is a machine learning model from mohdnahidmondol. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Quantized versions of Qwen/Qwen2.5-0.5B-Instruct using llama.cpp.
All-time downloads
559
Public
Repo size
3.2 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf3.2 GB · 100%
At a glance
- License
- apache-2.0
- Access
- Public
- Created
- Jun 28, 2026
- Updated
- Jun 28, 2026
- SHA
- 32133d0f
Base models
Model card
From the Hugging Face model README
Qwen2.5-0.5B-Instruct GGUF
Quantized versions of Qwen/Qwen2.5-0.5B-Instruct using llama.cpp.
Available quants
| File | Quant | Size |
|---|---|---|
| qwen-0.5b-fp16.gguf | FP16 | 948 MB |
| qwen-0.5b-q8_0.gguf | Q8_0 | 506 MB |
| qwen-0.5b-q6_K.gguf | Q6_K | 482 MB |
| qwen-0.5b-q5_k_m.gguf | Q5_K_M | 401 MB |
| qwen-0.5b-q4_k_m.gguf | Q4_K_M | 379 MB |
| qwen-0.5b-q3_k_m.gguf | Q3_K_M | 339 MB |
Usage
Ollama
ollama run hf.co/mmondol/qwen-0.5b-gguf:Q4_K_M
llama.cpp
llama cli -m qwen-0.5b-q4_k_m.gguf -p "Hello!"
- License
- apache-2.0
- Languages
- en
- Created
- Jun 28, 2026
- Updated
- Jun 28, 2026