Downloads · 30 days
38
17% of all-time downloads
agentbyumer/qwen2.5-1.5b-reasoning-GGUF
qwen2.5-1.5b-reasoning-GGUF is a machine learning model from agentbyumer. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
GGUF-quantized version of agentbyumer/qwen2.5-1.5b-reasoning, a QLoRA fine-tune of Qwen2.5-1.5B-Instruct trained on a subset of orca-math-word-problems-200k for step-by-step math word problem solving.
Downloads · 30 days
38
17% of all-time downloads
All-time downloads
220
Public
Repo size
2.6 GB
Likes
1
Public
Click a slice to open those files.
.gguf2.6 GB · 100%
From the Hugging Face model README
GGUF-quantized version of agentbyumer/qwen2.5-1.5b-reasoning, a QLoRA fine-tune of Qwen2.5-1.5B-Instruct trained on a subset of orca-math-word-problems-200k for step-by-step math word problem solving.
Intended for local/CPU inference via llama.cpp, LM Studio, Ollama, or similar
GGUF-compatible runtimes.
For full training details, evaluation notes, and known limitations, see the main model card.
| File | Quantization |
|---|---|
Qwen2.5-1.5B-Instruct.Q4_K_M.gguf | Q4_K_M — smaller, faster, lower precision |
Qwen2.5-1.5B-Instruct.Q8_0.gguf | Q8_0 — larger, higher precision |
llama-cli -hf agentbyumer/qwen2.5-1.5b-reasoning-GGUF --jinja