Downloads · 30 days
18
7% of all-time downloads
pererikgronvik/jamph-qwen2.5-coder-7b-instruct-q8_0
jamph-qwen2.5-coder-7b-instruct-q8_0 is a text generation model from pererikgronvik. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
Quantized version of Qwen/Qwen2.5-Coder-7B-Instruct using Q80.
Downloads · 30 days
18
7% of all-time downloads
All-time downloads
249
Public
Repo size
8.1 GB
Likes
0
Public
Click a slice to open those files.
.gguf8.1 GB · 100%
From the Hugging Face model README
Quantized version of Qwen/Qwen2.5-Coder-7B-Instruct using Q8_0.
jamph-qwen2.5-coder-7b-instruct-q8_0.gguf)# Download
huggingface-cli download pererikgronvik/jamph-qwen2.5-coder-7b-instruct-q8_0 jamph-qwen2.5-coder-7b-instruct-q8_0.gguf --local-dir .
# Run with llama.cpp
./llama-cli -m jamph-qwen2.5-coder-7b-instruct-q8_0.gguf -p "Your prompt"