Downloads · 30 days
43
19% of all-time downloads
Qwen2.5-GGUF
plasterlabs/Qwen2.5-GGUF
Qwen2.5-GGUF is a text generation model from plasterlabs. Use it when you need the model to write or continue text. It is set up for gguf. The card lists the license as apache-2.0.
This repo contains GGUF format model files for Qwen2.5-1.5B fine-tuned on the Chinese GSM8K dataset for mathematical reasoning.
All-time downloads
223
Public
Repo size
3.1 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf3.1 GB · 100%
At a glance
- Task
- Text Generation
- Library
- gguf
- License
- apache-2.0
- Access
- Public
- Created
- Mar 6, 2026
- Updated
- Mar 6, 2026
- SHA
- 8d83c618
Try a prompt
Base models
Datasets
Model card
From the Hugging Face model README
Qwen2.5-1.5B-GSM8K-zh-GGUF
This repo contains GGUF format model files for Qwen2.5-1.5B fine-tuned on the Chinese GSM8K dataset for mathematical reasoning.
The model has been fine-tuned to solve math word problems with step-by-step reasoning in Chinese.
Available Files
| Name | Quant Method | Size | Color | Description |
|---|---|---|---|---|
| [model-f16.gguf] | None | 2.88 GB | 🟢 | Full precision, maximum accuracy. |
| [model-q8_0.gguf] | Q8_0 | ~1.60 GB | 🔵 | Near-lossless, recommended for high-end use. |
| [model-q4_k_m.gguf] | Q4_K_M | ~1.00 GB | 🟣 | Recommended. Best balance of speed/logic. |
Usage (with llama.cpp)
You can use these files with any GGUF-compatible runner (Ollama, LM Studio, llama.cpp).
./llama-cli -m qwen2.5-1.5b-Q4_K_M.gguf -p "<|im_start|>user\n小明有5个苹果，吃了2个，还剩几个？<|im_end|>\n<|im_start|>assistant\n"
- Task
- Text Generation
- Library
- gguf
- License
- apache-2.0
- Languages
- en
- Created
- Mar 6, 2026
- Updated
- Mar 6, 2026