Downloads · 30 days
128
3% of all-time downloads
dspark-gemma4-12b-block7-Q4_0-GGUF
ankk98/dspark-gemma4-12b-block7-Q4_0-GGUF
dspark-gemma4-12b-block7-Q4_0-GGUF is a machine learning model from ankk98. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for gguf. The card lists the license as mit.
4-bit (pure Q40) GGUF draft for DSpark speculative decoding with google/gemma-4-12B-it.
All-time downloads
4.4K
Public
Repo size
1.9 GB
Likes
4
Public
Repo makeup
Click a slice to open those files.
.gguf1.9 GB · 100%
At a glance
- Library
- gguf
- License
- mit
- Access
- Public
- Created
- Jun 30, 2026
- Updated
- Jun 30, 2026
- SHA
- 3b2a4e77
Base models
Model card
From the Hugging Face model README
DSpark Gemma4 12B draft (Q4_0 GGUF)
4-bit (pure Q4_0) GGUF draft for DSpark speculative decoding with
[google/gemma-4-12B-it](https://huggingface.co/google/gemma-4-12B-it).
Converted with llama.cpp ft-dspark from
[deepseek-ai/dspark_gemma4_12b_block7](https://huggingface.co/deepseek-ai/dspark_gemma4_12b_block7).
Files
| File | Description |
|---|---|
dspark_gemma4_12b_q4pure.gguf | Draft model (~1.9 GB), LLM_ARCH_DSPARK |
Requirements
- llama.cpp built from
ft-dspark(or a release that includesdraft-dspark) - A separate target Gemma4 12B GGUF (not included here)
Usage
llama-cli \
-m /path/to/gemma-4-12B-it-Q4_0.gguf \
-md ./dspark_gemma4_12b_q4pure.gguf \
--spec-type draft-dspark \
--spec-draft-n-max 4 \
-c 512 -ngl 99 -ngld 99 \
-p "Your prompt" -n 128 --temp 0
- Library
- gguf
- License
- mit
- Created
- Jun 30, 2026
- Updated
- Jun 30, 2026