Downloads · 30 days
400
12% of all-time downloads
Qwen3.5-4B-GGUF-Q4_K_M
hinny/Qwen3.5-4B-GGUF-Q4_K_M
Qwen3.5-4B-GGUF-Q4_K_M is a machine learning model from hinny. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
GGUF conversion of Qwen/Qwen3.5-4B for llama.cpp.
All-time downloads
3.4K
Public
Repo size
11.1 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf11.1 GB · 100%
At a glance
- License
- apache-2.0
- Access
- Public
- Created
- Mar 3, 2026
- Updated
- Mar 3, 2026
- SHA
- 9471a816
Base models
Model card
From the Hugging Face model README
Qwen3.5-4B-GGUF-Q4_K_M
GGUF conversion of Qwen/Qwen3.5-4B for llama.cpp.
Files
Qwen3.5-4B-Q4_K_M.gguf(recommended for laptop use)Qwen3.5-4B-f16.gguf(source full precision)
Example (llama.cpp)
llama-cli -m Qwen3.5-4B-Q4_K_M.gguf -p "Hello"
- License
- apache-2.0
- Created
- Mar 3, 2026
- Updated
- Mar 3, 2026