Downloads · 30 days
48
35% of all-time downloads
Qwen2.5-Coder-7B-Instruct-iat-05-GGUF
playable/Qwen2.5-Coder-7B-Instruct-iat-05-GGUF
Qwen2.5-Coder-7B-Instruct-iat-05-GGUF is a machine learning model from playable. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
This is a GGUF quantized version (q4km) of Qwen/Qwen2.5-Coder-7B-Instruct fine-tuned with the 'iat-05' adapter.
All-time downloads
138
Public
Repo size
4.7 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf4.7 GB · 100%
At a glance
- License
- apache-2.0
- Access
- Public
- Created
- Oct 8, 2025
- Updated
- Oct 8, 2025
- SHA
- 1f56d036
Base models
Model card
From the Hugging Face model README
Qwen2.5-Coder-7B-Instruct-iat-05-GGUF
This is a GGUF quantized version (q4_k_m) of Qwen/Qwen2.5-Coder-7B-Instruct fine-tuned with the 'iat-05' adapter.
Model Details
- Base Model: Qwen/Qwen2.5-Coder-7B-Instruct
- Adapter: iat-05
- Quantization: q4_k_m
- Format: GGUF
Usage
This model can be used with llama.cpp or any compatible inference engine that supports GGUF format.
# Example with llama.cpp
./llama-cli -m Qwen2.5-Coder-7B-Instruct-iat-05-q4_k_m.gguf -p "Your prompt here"
Files
Qwen2.5-Coder-7B-Instruct-iat-05-q4_k_m.gguf- Quantized model in GGUF format (q4_k_m)
- License
- apache-2.0
- Created
- Oct 8, 2025
- Updated
- Oct 8, 2025