Downloads · 30 days
31
13% of all-time downloads
kabachuha/Gemma-4-The-Deckards-Brain-31B-NVFP4
Gemma-4-The-Deckards-Brain-31B-NVFP4 is a image-text-to-text model from kabachuha. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
NVFP4-quantized version of kabachuha/Gemma-4-The-Deckards-Brain-31B, a merge of two heretic Gemma 4 31B dense models with thinking capabilities.
Downloads · 30 days
31
13% of all-time downloads
All-time downloads
236
Public
Parameters
18.2B
19.7 GB on disk
Likes
2
Public
Click a slice to open those files.
.safetensors19.7 GB · 100%
How the weights are stored.
U814.9B · 82%
From the Hugging Face model README
NVFP4-quantized version of kabachuha/Gemma-4-The-Deckards-Brain-31B, a merge of two heretic Gemma 4 31B dense models with thinking capabilities.
Calibration was done on r/writingprompts story continuations using the modelopt library.
For 5090: Assuming you don't run heavy processes, you can easily fully fit up to ~49000 tokens context into a single GPU. This gives around 60+ tokengen/s.
Convertation to GGUF is made easily with llama.cpp's convert_hf_to_gguf.py.
The prompt format is fully inherited from DavidAU's The Deckard Thinking, meaning the chat template will have thinking by default. To disable, override the chat template with chat_template-instruct.jinja.
Thinking is highly recommended to not be ever turned off! If you are role-playing in non-English, this is crucial to bring your language output distribution closer to the English/Japanese training set, otherwise it will be much more bland and more censored!
For the rest of the information, see the original model card.