Downloads · 30 days
111
7% of all-time downloads
batiai/Qwen3.5-35B-A3B-GGUF
Qwen3.5-35B-A3B-GGUF is a text generation model from batiai. Use it when you need the model to write or continue text. It is set up for llama.cpp. The card lists the license as apache-2.0.
<p align="center" <a href="https://flow.bati.ai"<img src="https://img.shields.io/badge/BatiFlow-macOS%20AI%20Automation-blue?style=for-the-badge&logo=apple" alt="BatiFlow"</a <a href="https://ollama.com/batiai/qwen3.5…
Downloads · 30 days
111
7% of all-time downloads
All-time downloads
1.7K
Public
Repo size
18.7 GB
Likes
0
Public
Click a slice to open those files.
.gguf18.7 GB · 100%
From the Hugging Face model README
IQ4_XS quantization of Qwen/Qwen3.5-35B-A3B for on-device AI on Mac. Built and verified by BatiAI for BatiFlow.
ollama pull batiai/qwen3.5-35b:iq4
| Quant | Size | VRAM | M4 Max (128GB) | Recommended For |
|---|---|---|---|---|
| IQ4_XS | 17GB | 23GB | 26.6 t/s | 36GB+ Mac |
35B-A3B is a Mixture-of-Experts model — 35B total, only 3B active per token:
| 35B-A3B (MoE) | 27B (Dense) | |
|---|---|---|
| Total params | 35B | 27B |
| Active params | 3B | 27B |
| VRAM | 23GB | 28GB |
| Speed | 26.6 t/s | 17.0 t/s |
MoE activates 9x fewer parameters — same quality, much faster, less memory.
| Metric | IQ4_XS |
|---|---|
| Token generation | 26.6 t/s |
| Korean | ✅ |
| Tool call JSON | ✅ |
| VRAM | 23 GB |
| Model | Size | VRAM | Speed | Min Mac |
|---|---|---|---|---|
| batiai/qwen3.5-9b:q4 | 5.2GB | ~8GB | 12.5 t/s | 16GB |
| batiai/qwen3.5-27b:iq4 | 14GB | 28GB | 17.0 t/s | 32GB |
| batiai/qwen3.5-35b:iq4 | 17GB | 23GB | 26.6 t/s | 36GB |
BatiFlow — free, on-device AI automation for Mac. 5MB app, 100% local, unlimited.
Quantized from Qwen/Qwen3.5-35B-A3B. License: Apache 2.0.
| Machine | Quant | Cold start | Prompt eval | Token gen | Tested |
|---|---|---|---|---|---|
| MacBook Pro M4 Max 128GB | IQ4_XS | 4.825s | 205.28 t/s | 44.77 t/s | 2026-05-03 |