Downloads · 30 days
8
10% of all-time downloads
Brianpuze/Qwen2.5-0.5B-Q4_K_M-GGUF
Qwen2.5-0.5B-Q4_K_M-GGUF is a text generation model from Brianpuze. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This repo contains GGUF quantized versions of Qwen/Qwen2.5-0.5B using llama.cpp.
Downloads · 30 days
8
10% of all-time downloads
All-time downloads
83
Public
Repo size
398 MB
Likes
0
Public
Click a slice to open those files.
.gguf398 MB · 100%
From the Hugging Face model README
This repo contains GGUF quantized versions of Qwen/Qwen2.5-0.5B using llama.cpp.
llama-cli --hf-repo Brianpuze/Qwen2.5-0.5B-Q4_K_M-GGUF --hf-file qwen2.5-0.5b-q4_k_m.gguf -p