Skip to content

Kh0rd

gemma-4-12B-it-qat-assistant-q8_0-gguf

Kh0rd/gemma-4-12B-it-qat-assistant-q8_0-gguf

gemma-4-12B-it-qat-assistant-q8_0-gguf is a text generation model from Kh0rd. Use it when you need the model to write or continue text. The card lists the license as gemma.

GGUF Q80 conversion of google/gemma-4-12B-it-qat-q40-unquantized-assistant. Intended for use as a draft model with llama-server's speculative decoding (--spec-type draft-mtp) to accelerate the main model's generation…

Downloads · 30 days

14

2% of all-time downloads

All-time downloads

565

Public

Repo size

465 MB

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.gguf465 MB · 100%

At a glance

Task
Text Generation
License
gemma
Access
Public
Created
Jun 8, 2026
Updated
Jun 8, 2026
SHA
d19d1c64

Try a prompt

Base models

Task
Text Generation
License
gemma
Languages
en, ja
Created
Jun 8, 2026
Updated
Jun 8, 2026