Downloads · 30 days
340
36% of all-time downloads
jc-builds/Qwen3.5-0.8B-Q4_K_M-GGUF
Qwen3.5-0.8B-Q4_K_M-GGUF is a text generation model from jc-builds. Use it when you need the model to write or continue text. It is set up for gguf. The card lists the license as apache-2.0.
A Q4KM GGUF of Qwen/Qwen3.5-0.8B for on-device inference on any iPhone, iPad, or Apple Silicon Mac via llama.cpp or apps that wrap it (e.g. Haplo).
Downloads · 30 days
340
36% of all-time downloads
All-time downloads
955
Public
Repo size
533 MB
Likes
3
Public
Click a slice to open those files.
.gguf533 MB · 100%
From the Hugging Face model README
A Q4_K_M GGUF of Qwen/Qwen3.5-0.8B for on-device inference on any iPhone, iPad, or Apple Silicon Mac via llama.cpp or apps that wrap it (e.g. Haplo).
Hosted by jc-builds for the Haplo ecosystem. Quantization by Unsloth. Original weights © Alibaba Cloud, redistributed under the Apache 2.0 License.
The smallest model in Alibaba's Qwen3.5 family, using the same hybrid Gated DeltaNet + attention architecture as its larger siblings. At about half a gigabyte it runs on every supported device, and it is a large step up from the previous generation of sub-1B models. It runs in non-thinking mode by default.
| File | Size | Recommended use |
|---|---|---|
Qwen3.5-0.8B-Q4_K_M.gguf | 0.53 GB | Default — works on every device |
| Parameters | 0.8B |
| Architecture | qwen35 (hybrid Gated DeltaNet + attention) |
| Quantization | Q4_K_M |
| Chat format | ChatML with an optional <think> block (non-thinking by default) |
| Minimum device | Any iPhone that runs Haplo |
The model appears automatically in Haplo's model browser. Download URL:
https://huggingface.co/jc-builds/Qwen3.5-0.8B-Q4_K_M-GGUF/resolve/main/Qwen3.5-0.8B-Q4_K_M.gguf
llama-cli -hf jc-builds/Qwen3.5-0.8B-Q4_K_M-GGUF:Q4_K_M
Apache 2.0. Qwen3.5 by Alibaba Cloud — see the upstream license.