Downloads · 30 days
54
3% of all-time downloads
Qwen3.5-27B-GGUF
batiai/Qwen3.5-27B-GGUF
Qwen3.5-27B-GGUF is a text generation model from batiai. Use it when you need the model to write or continue text. It is set up for llama.cpp. The card lists the license as apache-2.0.
🆕 Newer model available — Qwen3.8-27B GGUF Qwen's 2026-08 release. Same 27B class, six quants from 10 GB, vision included, Korean-verified. ollama run batiai/qwen3.8-27b:iq4
All-time downloads
2.1K
Public
Repo size
15.1 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf15.1 GB · 100%
At a glance
- Task
- Text Generation
- Library
- llama.cpp
- License
- apache-2.0
- Access
- Public
- Created
- Apr 13, 2026
- Updated
- Aug 16, 2026
- SHA
- 4f810bbd
Try a prompt
Base models
Model card
From the Hugging Face model README
Qwen 3.5 27B GGUF — Quantized by BatiAI
<p align="center"> <a href="https://flow.bati.ai"><img src="https://img.shields.io/badge/BatiFlow-macOS%20AI%20Automation-blue?style=for-the-badge&logo=apple" alt="BatiFlow"></a> <a href="https://ollama.com/batiai/qwen3.5-27b"><img src="https://img.shields.io/badge/Ollama-batiai%2Fqwen3.5--27b-green?style=for-the-badge" alt="Ollama"></a> </p>🆕 Newer model available — Qwen3.8-27B GGUF Qwen's 2026-08 release. Same 27B class, six quants from 10 GB, vision included, Korean-verified.
ollama run batiai/qwen3.8-27b:iq4
IQ4_XS quantization of Qwen/Qwen3.5-27B for on-device AI on Mac. Built and verified by BatiAI for BatiFlow.
Quick Start
ollama pull batiai/qwen3.5-27b:iq4
Available Quantizations
| Quant | Size | VRAM | M4 Max (128GB) | Recommended For |
|---|---|---|---|---|
| IQ4_XS | 14GB | 28GB | 17.0 t/s | 32GB+ Mac |
Benchmarks — M4 Max (128GB)
| Metric | IQ4_XS |
|---|---|
| Token generation | 17.0 t/s |
| Korean | ✅ |
| Tool call JSON | ✅ |
| VRAM | 28 GB |
vs Other Qwen 3.5 Models
| Model | Size | VRAM | Speed | Min Mac |
|---|---|---|---|---|
| batiai/qwen3.5-9b:q4 | 5.2GB | ~8GB | 12.5 t/s | 16GB |
| batiai/qwen3.5-27b:iq4 | 14GB | 28GB | 17.0 t/s | 32GB |
| batiai/qwen3.5-35b:iq4 | 17GB | 23GB | 26.6 t/s | 36GB |
For 36GB+ Mac, consider batiai/qwen3.5-35b — MoE architecture, faster and less VRAM.
Technical Details
- Original Model: Qwen/Qwen3.5-27B
- Architecture: Hybrid (Gated DeltaNet + GQA + MoE)
- Context Window: 262K tokens
- License: Apache 2.0
- Quantized with: llama.cpp (build 400ac8e)
About BatiFlow
BatiFlow — free, on-device AI automation for Mac. 5MB app, 100% local, unlimited.
License
Quantized from Qwen/Qwen3.5-27B. License: Apache 2.0.
Benchmarks
<!-- BENCH-START -->| Machine | Quant | Cold start | Prompt eval | Token gen | Tested |
|---|---|---|---|---|---|
| MacBook Pro M4 Max 128GB | IQ4_XS | 4.827s | 82.37 t/s | 11.71 t/s | 2026-05-03 |
- Task
- Text Generation
- Library
- llama.cpp
- License
- apache-2.0
- Languages
- en, ko, ja, zh
- Created
- Apr 13, 2026
- Updated
- Aug 16, 2026