Downloads · 30 days
46
6% of all-time downloads
Qwen2.5-Coder-3B-GGUF
olegshulyakov/Qwen2.5-Coder-3B-GGUF
Qwen2.5-Coder-3B-GGUF is a text generation model from olegshulyakov. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
Model creator: Qwen<br/ Original model: Qwen/Qwen2.5-Coder-3B<br/ GGUF quantization: provided by olegshulyakov using llama.cpp<br/ 🙏 Special thanks to Georgi Gerganov and the whole team working on llama.cpp for makin…
All-time downloads
717
Public
Repo size
2.3 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.gguf2.3 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- other
- Access
- Public
- Created
- Sep 13, 2025
- Updated
- Sep 20, 2025
- SHA
- cfb34534
Try a prompt
Base models
Model card
From the Hugging Face model README
Qwen2.5-Coder-3B
Model creator: Qwen<br/>
Original model: Qwen/Qwen2.5-Coder-3B<br/>
GGUF quantization: provided by olegshulyakov using llama.cpp<br/>
Special thanks
🙏 Special thanks to Georgi Gerganov and the whole team working on llama.cpp for making all of this possible.
Use with Ollama
ollama run "hf.co/olegshulyakov/Qwen2.5-Coder-3B-GGUF:Q5_K_XL"
Use with LM Studio
lms load "olegshulyakov/Qwen2.5-Coder-3B-GGUF"
Use with llama.cpp CLI
llama-cli -hf olegshulyakov/Qwen2.5-Coder-3B-GGUF:Q5_K_XL -p "The meaning to life and the universe is"
Use with llama.cpp Server:
llama-server -hf olegshulyakov/Qwen2.5-Coder-3B-GGUF:Q5_K_XL -ngl 99 -c 0
- Task
- Text Generation
- Library
- transformers
- License
- other
- Languages
- en
- Created
- Sep 13, 2025
- Updated
- Sep 20, 2025