Downloads · 30 days
29
28% of all-time downloads
Brianpuze/Qwen2-0.5B-Q4_K_M-GGUF
Qwen2-0.5B-Q4_K_M-GGUF is a text generation model from Brianpuze. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
Absolutely tremendous! This repo features GGUF quantized versions of Qwen/Qwen2-0.5B — made possible using the very powerful llama.cpp. Believe me, it's fast, it's smart, it's winning. Only the best quantization. You’…
Downloads · 30 days
29
28% of all-time downloads
All-time downloads
102
Public
Repo size
398 MB
Likes
0
Public
Click a slice to open those files.
.gguf398 MB · 100%
From the Hugging Face model README
Absolutely tremendous! This repo features GGUF quantized versions of Qwen/Qwen2-0.5B — made possible using the very powerful llama.cpp. Believe me, it's fast, it's smart, it's winning.
Only the best quantization. You’ll love it.
Just plug it in, hit the command line, and boom — you're running world-class AI, folks:
llama-cli --hf-repo Brianpuze/Qwen2-0.5B-Q4_K_M-GGUF --hf-file qwen2-0.5b-q4_k_m.gguf -p "AI First, but also..."
This beautiful Hugging Face Space was brought to you by the amazing team at Antigma Labs. Great people. Big vision. Doing things that matter — and doing them right. Total winners.