Downloads · 30 days
109
2% of all-time downloads
ankk98/dspark-qwen3-8b-block7-Q4_K_M-GGUF
dspark-qwen3-8b-block7-Q4_K_M-GGUF is a machine learning model from ankk98. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
Q4KM GGUF draft for DSpark speculative decoding with Qwen3-8B. Pair it with any Qwen3-8B target GGUF (e.g. Qwen3-8B-Q4KM.gguf).
Downloads · 30 days
109
2% of all-time downloads
All-time downloads
4.4K
Public
Repo size
1.5 GB
Likes
5
Public
Click a slice to open those files.
.gguf1.5 GB · 100%
From the Hugging Face model README
Q4_K_M GGUF draft for DSpark speculative decoding with Qwen3-8B. Pair it with any Qwen3-8B target GGUF (e.g. Qwen3-8B-Q4_K_M.gguf).
Converted from deepseek-ai/dspark_qwen3_8b_block7 with llama.cpp (LLM_ARCH_DSPARK). This repo contains only the draft weights (~1.5 GB), not the target model.
llama-cli \
-m /path/to/Qwen3-8B-Q4_K_M.gguf \
-md ./dspark_qwen3_8b_block7.q4_k_m.gguf \
--spec-type draft-dspark \
--spec-draft-n-max 7 \
-c 512 -ngl 99 -ngld 99 \
-p "Your prompt" -n 128 --temp 0