Downloads · 30 days
16.5K
9% of all-time downloads
Qwen3.6-27B-DFlash-GGUF-llama.cpp
Alittlehammmer/Qwen3.6-27B-DFlash-GGUF-llama.cpp
Qwen3.6-27B-DFlash-GGUF-llama.cpp is a text generation model from Alittlehammmer. Use it when you need the model to write or continue text. It is set up for gguf. The card lists the license as apache-2.0.
GGUF quantizations of z-lab/Qwen3.6-27B-DFlash.
All-time downloads
183K
Public
Repo size
9 GB
Likes
19
Public
Repo makeup
Click a slice to open those files.
.gguf9 GB · 100%
At a glance
- Task
- Text Generation
- Library
- gguf
- License
- apache-2.0
- Access
- Public
- Created
- Jun 29, 2026
- Updated
- Jun 29, 2026
- SHA
- 5f2ed671
Try a prompt
Base models
Model card
From the Hugging Face model README
Qwen3.6-27B-DFlash
GGUF quantizations of z-lab/Qwen3.6-27B-DFlash.
Converted to BF16 using convert_hf_to_gguf.py, then quantized using llama-quantize from llama.cpp.
Available quants
| Quant | Bits | Size | Notes |
|---|---|---|---|
| Q4_K_M | 4 | ~1.03 GB | Average quality |
| Q5_K | 5 | ~1.22 GB | High quality |
| Q6_K | 6 | ~1.43 GB | Very high quality |
| Q8_0 | 8 | ~1.84 GB | Highest quality, near lossless, Recommended |
| BF16 | 16 | ~3.47 GB | Full precision, reference file |
Usage
Use in conjunction with existing Qwen3.6 Quants, example config if using llama-server:
[Qwen3.6-27B-Q8_0-DFlash]
sm = layer
model = /mnt/gguf/Qwen3.6-27B/Qwen3.6-27B-Q8_0.gguf
model-draft = /mnt/gguf/Qwen3.6-27B/Qwen3.6-27B-DFlash-Q8_0.gguf
spec-type = draft-dflash
spec-draft-n-max = 6
(Note: For some reason I cannot get sm = tensor to work, it crashes on launch, pretty sure this is an issue in llama.cpp)
Original model
See the original model card for details on capabilities, benchmarks, and license.
- Task
- Text Generation
- Library
- gguf
- License
- apache-2.0
- Created
- Jun 29, 2026
- Updated
- Jun 29, 2026