Qwen2.5-Coder-3B-High

Qwen2.5-Coder-3B-High

Fine-tuned version of Qwen2.5-Coder-3B optimized specifically for Python programming tasks. Outperforms the base model on Python-related problems, code generation, and real-world development scenarios.

---

🚀 Overview

This repository hosts a fine-tuned variant of Qwen2.5-Coder-3B, trained on a high-quality dataset of Python programming problems, coding challenges, and real-world software engineering examples. The fine-tuning process significantly enhances the model’s ability to understand and generate idiomatic, efficient, and correct Python code.

✅ Key Improvements Over Base Model:

• Higher accuracy on Python syntax, standard library usage, and common frameworks (e.g., Pandas, NumPy, asyncio)
• Better code completion and function generation from natural language prompts
• Improved reasoning for algorithmic problems (e.g., sorting, recursion, data structures)
• More consistent and readable output formatting

---

📦 Model Files (GGUF Format)

All models are provided in GGUF format for broad compatibility with inference engines like llama.cpp, Ollama, LM Studio, and more.

💡 Recommendation: Start with Q5_K_M for most local development tasks.

---

📈 Performance

Evaluated on an internal benchmark of 200 Python-specific prompts (including LeetCode-style problems, docstring-to-code, bug fixes, and library usage):

🔍 Benchmark details available upon request.

---

🛠️ Usage Examples

With llama.cpp

./main -m ./models/Qwen2.5-Coder-3B-High.Q5_K_M.gguf \
       -p "Write a Python function that takes a list of integers and returns the sum of even numbers." \
       -n 256 --temp 0.2