Downloads · 30 days
35
1% of all-time downloads
jojohai/Qwen3.6-27B-DFlash-GGUF
Qwen3.6-27B-DFlash-GGUF is a machine learning model from jojohai. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
This is the conversion of z-lab/Qwen3.6-27B-DFlash to be used with llama.cpp folowing the method in the first post https://github.com/ggml-org/llama.cpp/pull/22105 Offered as a convenience.
Downloads · 30 days
35
1% of all-time downloads
All-time downloads
4.3K
Public
Repo size
934 MB
Likes
8
Public
Click a slice to open those files.
.gguf934 MB · 100%
From the Hugging Face model README
This is the conversion of z-lab/Qwen3.6-27B-DFlash to be used with llama.cpp folowing the method in the first post https://github.com/ggml-org/llama.cpp/pull/22105 Offered as a convenience.
DFlash is a second model to load as a drafter.
The command : As of June 29, I tested it against ROCm, Vulkan Fails. I expect CUDA to work
llama-server \
-m /models/Qwen3.6-27B-GGUF-4.256bpw-imatrix.gguf \
--spec-draft-n-max 8 \
--spec-type draft-dflash --spec-draft-model /models/qwen3.6-27b-dflash-IQ4_XS.gguf \
-a "qwen-27b" \
--host 127.0.0.1 \
--port 17102 \
--device ROCm0 \
-c 40000 \
-ngl 40 \