Downloads · 30 days
87
10% of all-time downloads
cattoroboto/Qwen2-0.5B-Instruct-GGUF-Q2_K
Qwen2-0.5B-Instruct-GGUF-Q2_K is a machine learning model from cattoroboto. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Downloads · 30 days
87
10% of all-time downloads
All-time downloads
878
Public
Repo size
339 MB
Likes
0
Public
Click a slice to open those files.
.gguf339 MB · 100%
From the Hugging Face model README
smol
GGUF Quants of Qwen/Qwen2-0.5B-Instruct
Built with llama.cpp using this version
There is an official GGUF quant, but it was missing the Q2_K quant.