Downloads · 30 days
91
4% of all-time downloads
Qwen3.5-76B-GGUF
0xSero/Qwen3.5-76B-GGUF
Qwen3.5-76B-GGUF is a text generation model from 0xSero. Use it when you need the model to write or continue text. It is set up for gguf. The card lists the license as mit.
[!TIP] Support this work → · X · GitHub · REAP paper · Cerebras REAP
All-time downloads
2.1K
Public
Repo size
46.2 GB
Likes
5
Public
Repo makeup
Click a slice to open those files.
.gguf46.2 GB · 100%
At a glance
- Task
- Text Generation
- Library
- gguf
- License
- mit
- Access
- Public
- Created
- Apr 12, 2026
- Updated
- May 30, 2026
- SHA
- b3369256
Try a prompt
Model card
From the Hugging Face model README
[!TIP] Support this work → · X · GitHub · REAP paper · Cerebras REAP
Qwen3.5-76B-GGUF
GGUF quantization of the base model.
At a glance
| Base model | — |
| Format | GGUF |
| Total params | 76B |
| Active / token | 10B |
| Experts / layer | — |
| Layers | — |
| Hidden size | — |
| Context | — |
| On-disk size | 46 GB |
Which variant should I pick?
| Variant | Format | Link |
|---|---|---|
Qwen3.5-264B | BF16 | link |
Qwen3.5-264B-FP8 | FP8 | link |
Qwen3.5-264B-W4A16 | W4A16 | link |
Qwen3.5-28B | BF16 | link |
Qwen3.5-35B-EXL3-4bpw | EXL3-4bpw | link |
Qwen3.5-76B | BF16 | link |
Qwen3.5-76B-GGUF (this) | GGUF | link |
Qwen3.5-88B | BF16 | link |
Qwen3.5-99B | BF16 | link |
Qwen3.5-99B-GGUF | GGUF | link |
Model repository for 0xSero/Qwen3.5-76B-GGUF.
License & citation
License inherited from the base model.
@misc{lasby2025reap,
title = {REAP the Experts: Why Pruning Prevails for One-Shot MoE Compression},
author = {Mike Lasby and Ivan Lazarevich and Nish Sinnadurai and Sean Lie and Yani Ioannou and Vithursan Thangarasa},
year = {2025}, eprint = {2510.13999}, archivePrefix = {arXiv}
}
Sponsors
Made possible by NVIDIA · TNG Technology · Lambda · Prime Intellect · Hot Aisle.
- Task
- Text Generation
- Library
- gguf
- License
- mit
- Created
- Apr 12, 2026
- Updated
- May 30, 2026