Downloads · 30 days
29
9% of all-time downloads
Qwen3.5-122B-A10B-DFlash-GGUF
cso3987/Qwen3.5-122B-A10B-DFlash-GGUF
Qwen3.5-122B-A10B-DFlash-GGUF is a text generation model from cso3987. Use it when you need the model to write or continue text. It is set up for gguf.
GGUF made to use in ikawrakow/ikllama.cpp, currently for PR 1970. The small quantizations delivered here are made for test purposes; feel free to create your own quantization.
All-time downloads
335
Public
Repo size
2.5 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf1.9 GB · 100%
At a glance
- Task
- Text Generation
- Library
- gguf
- Access
- Public
- Created
- Aug 16, 2026
- Updated
- Aug 16, 2026
- SHA
- d2ef31a4
Try a prompt
Base models
Model card
From the Hugging Face model README
Qwen 3.5 122B A10B DFlash GGUF
GGUF made to use in ikawrakow/ik_llama.cpp, currently for PR #1970. The small quantizations delivered here are made for test purposes; feel free to create your own quantization.
Derived from the safetensors DFlash draft model z-lab/Qwen3.5-122B-A10B-DFlash.
Compatible target model
Qwen_Qwen3.5-122B-A10B.gguf- Mainly tested with IQ3_M.
Files
| File | Quant | Size |
|---|---|---|
qwen35-122b-a10b-dflash-F16.gguf | F16 | 983 MB |
qwen35-122b-a10b-dflash-Q8_0.gguf | Q8_0 | 527 MB |
qwen35-122b-a10b-dflash-Q4_K_M.gguf | Q4_K_M | 299 MB |
Usage
./build/bin/llama-server \
--model <target.gguf> \
--model-draft <draft.gguf> \
--spec-type dflash:n_max=<N>,cross_ctx=<N> ...
Notes
- This repo contains DFlash draft models, not a standalone instruct model.
- Use it with the matching target family listed above.
Q4_K_MandQ8_0are small test-oriented quants; create your own quant if you need a different tradeoff.
- Task
- Text Generation
- Library
- gguf
- Created
- Aug 16, 2026
- Updated
- Aug 16, 2026