Downloads · 30 days
55
28% of all-time downloads
Qwen2.5-Coder-7B-Instruct-iat-03-GGUF
playable/Qwen2.5-Coder-7B-Instruct-iat-03-GGUF
Qwen2.5-Coder-7B-Instruct-iat-03-GGUF is a machine learning model from playable. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
This is a GGUF quantized version (q4km) of Qwen/Qwen2.5-Coder-7B-Instruct fine-tuned with the 'iat-03' adapter.
All-time downloads
199
Public
Repo size
4.7 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf4.7 GB · 100%
At a glance
- License
- apache-2.0
- Access
- Public
- Created
- Oct 6, 2025
- Updated
- Oct 6, 2025
- SHA
- e7577aaa
Base models
Model card
From the Hugging Face model README
Qwen2.5-Coder-7B-Instruct-iat-03-GGUF
This is a GGUF quantized version (q4_k_m) of Qwen/Qwen2.5-Coder-7B-Instruct fine-tuned with the 'iat-03' adapter.
Model Details
- Base Model: Qwen/Qwen2.5-Coder-7B-Instruct
- Adapter: iat-03
- Quantization: q4_k_m
- Format: GGUF
Usage
This model can be used with llama.cpp or any compatible inference engine that supports GGUF format.
# Example with llama.cpp
./llama-cli -m model_q4_k_m.gguf -p "Your prompt here"
Files
model_q4_k_m.gguf- Quantized model in GGUF format (q4_k_m)
- License
- apache-2.0
- Created
- Oct 6, 2025
- Updated
- Oct 6, 2025