Downloads · 30 days
60
13% of all-time downloads
pererikgronvik/jamph-qwen2.5-coder-14b-instruct-q5_k_m
jamph-qwen2.5-coder-14b-instruct-q5_k_m is a text generation model from pererikgronvik. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
Quantized version of Qwen/Qwen2.5-Coder-14B-Instruct using Q5KM.
Downloads · 30 days
60
13% of all-time downloads
All-time downloads
478
Public
Repo size
10.5 GB
Likes
0
Public
Click a slice to open those files.
.gguf10.5 GB · 100%
From the Hugging Face model README
Quantized version of Qwen/Qwen2.5-Coder-14B-Instruct using Q5_K_M.
jamph-qwen2.5-coder-14b-instruct-q5_k_m.gguf)# Download
huggingface-cli download pererikgronvik/jamph-qwen2.5-coder-14b-instruct-q5_k_m jamph-qwen2.5-coder-14b-instruct-q5_k_m.gguf --local-dir .
# Run with llama.cpp
./llama-cli -m jamph-qwen2.5-coder-14b-instruct-q5_k_m.gguf -p "Your prompt"