Downloads · 30 days
65
8% of all-time downloads
zen5-max-gguf
zenlm/zen5-max-gguf
zen5-max-gguf is a text generation model from zenlm. Use it when you need the model to write or continue text. It is set up for gguf. The card lists the license as mit.
Top tier of the Zen5 family. The full-Pro base, asymmetrically quantized (routed IQ2XXS up/gate, Q2K down; shared experts, attention projections, routing logits and the LM head left at higher precision).
All-time downloads
861
Public
Repo size
465 GB
Likes
2
Public
Repo makeup
Click a slice to open those files.
.gguf465 GB · 100%
At a glance
- Task
- Text Generation
- Library
- gguf
- License
- mit
- Access
- Public
- Created
- May 30, 2026
- Updated
- Jul 14, 2026
- SHA
- 7e6e88eb
Try a prompt
Base models
Model card
From the Hugging Face model README
Zen5 Max
Top tier of the Zen5 family. The full-Pro base, asymmetrically quantized (routed IQ2_XXS up/gate, Q2_K down; shared experts, attention projections, routing logits and the LM head left at higher precision).
Repackaged from deepseek-ai/DeepSeek-V4-Pro (mit, DeepSeek) — quantized to GGUF from the abliterated variant by huihui-ai. Not trained from scratch — a permissively-licensed redistribution for the OSS-clean Zen model line.
Use when you have 512 GB+ unified memory (Mac Studio M3 Ultra 512 GB) or an 8x H100 / H200 pool and want the deepest reasoning quality in the family. For 128 GB hardware, use zenlm/zen-5-pro-gguf instead.
Part of the canonical Zen5 ladder:
| SKU | Hardware fit | This repo |
|---|---|---|
zen5-flash | anything | zen-5-flash-gguf |
zen5-mini | 32 GB | zen-5-mini-gguf |
zen5 (default) | 24 GB+ VRAM | zen-5-gguf |
zen5-pro | 128 GB single-machine | zen-5-pro-gguf |
zen5-max | 512 GB Mac Studio / 8x H100 | ← you are here |
Files
| File pattern | Size | Quant |
|---|---|---|
main GGUF (*-IQ2XXS-w2Q2K-*-Instruct-imatrix.gguf) | 432 GB | routed IQ2_XXS + Q2_K, shared Q8_0, attn Q8_0, imatrix-tuned |
Run
Hosted via the Hanzo gateway (api.hanzo.ai) as zen5-max.
Local with the zen5-engine:
git clone https://github.com/zenlm/zen5-engine
cd zen5-engine && make # macOS Metal
# or: make cuda-generic for multi-H100
hf download zenlm/zen-5-max-gguf --local-dir gguf
ln -sf "$(ls gguf/*-Instruct-imatrix.gguf | head -1)" zen5max.gguf
./zen5 -m zen5max.gguf -p "Explain MoE inference."
./zen5-server -m zen5max.gguf --ctx 1000000 --kv-disk-dir /tmp/zen5-kv --kv-disk-space-mb 16384
License
apache-2.0 (this packaging). Upstream: deepseek-ai/DeepSeek-V4-Pro by DeepSeek, licensed MIT; abliterated variant by huihui-ai. This repository redistributes a quantized derivative; the upstream MIT terms are retained.
- Task
- Text Generation
- Library
- gguf
- License
- mit
- Languages
- en, zh
- Created
- May 30, 2026
- Updated
- Jul 14, 2026