Downloads · 30 days
2K
61% of all-time downloads
Qwen3.8-Flash-Next-GGUF
vumpt/Qwen3.8-Flash-Next-GGUF
Qwen3.8-Flash-Next-GGUF is a image-text-to-text model from vumpt. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for llama.cpp. The card lists the license as other.
GGUF conversion of Qwen/Qwen3.8-Flash-Next, the Qwen4-experimental hybrid model (Gated DeltaNet + Qwen Sparse Attention + 512-expert MoE + n-gram "PLE" embedding table).
All-time downloads
3.2K
Public
Repo size
119 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.gguf119 GB · 100%
At a glance
- Task
- Image-Text-to-Text
- Library
- llama.cpp
- License
- other
- Access
- Public
- Created
- Aug 26, 2026
- Updated
- Aug 26, 2026
- SHA
- 83a79fc5
Try a prompt
Base models
Model card
From the Hugging Face model README
Qwen3.8-Flash-Next — GGUF (Q4_K_M)
GGUF conversion of Qwen/Qwen3.8-Flash-Next, the Qwen4-experimental hybrid model (Gated DeltaNet + Qwen Sparse Attention + 512-expert MoE + n-gram "PLE" embedding table).
- 125B total MoE params (6B active) + 51B n-gram table + 4B MTP = 180B params
- Converted with the in-flight llama.cpp PR #27742 (
qwen4exparchitecture support)
Quantization layout
Q4_K_M recipe. Because several tensor shapes in this architecture aren't divisible by 256, llama.cpp's type-fallback applies per-tensor (this is a feature of PR #27742's quantizer fixes, not an error):
| Component | Quant |
|---|---|
| MoE experts / attention / FFN | Q4_K_M (fallback to Q5_0/q8_0 where ncols % 256 ≠ 0) |
| Token embedding + output | Q6_K |
| N-gram (PLE) hash table (51B params) | Q5_0 (160-col layout → falls back from Q6_K) |
Files
| File | Quant | Size |
|---|---|---|
qwen3.8-flash-next-Q4_K_M.gguf | Q4_K_M | ~120 GB |
Usage (llama.cpp)
git clone https://github.com/ggml-org/llama.cpp
cd llama.cpp
git fetch origin pull/27742/head:qwen4exp && git checkout qwen4exp
cmake -B build && cmake --build build -j --target llama-cli
./build/bin/llama-cli -m qwen3.8-flash-next-Q4_K_M.gguf -p "Hello" -ngl 99
Note: This architecture is only supported on the PR #27742 branch. Mainline
llama.cpp(as of this writing) does not loadqwen4_exp. Use the branch above.
Source
- Weights: Qwen/Qwen3.8-Flash-Next (bf16, 360 GB)
- License: qwen-community-1.0
- Task
- Image-Text-to-Text
- Library
- llama.cpp
- License
- other
- Created
- Aug 26, 2026
- Updated
- Aug 26, 2026