Downloads · 30 days
41
13% of all-time downloads
qwen25coder-7b-quantized-gguf
catalin-pangaleanu/qwen25coder-7b-quantized-gguf
qwen25coder-7b-quantized-gguf is a text generation model from catalin-pangaleanu. Use it when you need the model to write or continue text.
This repository provides a GGUF quantized version of a Qwen2-based coding assistant model for local inference. It is intended to support code-focused questions in a repository-grounded setting.
All-time downloads
326
Public
Repo size
4.7 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf4.7 GB · 100%
At a glance
- Task
- Text Generation
- Access
- Public
- Created
- Apr 17, 2026
- Updated
- Apr 17, 2026
- SHA
- 6b460ce9
Try a prompt
Base models
Model card
From the Hugging Face model README
Quantized Coding Assistant (GGUF)
This repository provides a GGUF quantized version of a Qwen2-based coding assistant model for local inference. It is intended to support code-focused questions in a repository-grounded setting.
Model Details
- Base model:
Qwen/Qwen2.5-Coder-7B-Instruct - Format: GGUF
- Architecture: Qwen2
- Model size: 8B parameters
- Quantization: 4-bit
Q4_K_M - File size: 4.68 GB
Notes
This repository contains a quantized GGUF model for inference. The corresponding LoRA adapter repository contains the adapter weights and configuration used during fine-tuning. The adapter was built on top of Qwen/Qwen2.5-Coder-7B-Instruct with LoRA rank 16, alpha 16, dropout 0.05, targeting q_proj, k_proj, v_proj, and o_proj.
- Task
- Text Generation
- Created
- Apr 17, 2026
- Updated
- Apr 17, 2026