Downloads · 30 days
394
4% of all-time downloads
CountCandy/gemma-4-31B-it-The-DECKARD-HERETIC-UNCENSORED-Thinking-GGUFs
gemma-4-31B-it-The-DECKARD-HERETIC-UNCENSORED-Thinking-GGUFs is a image-text-to-text model from CountCandy. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for mlx. The card lists the license as apache-2.0.
This is a Deckard(qx) experimental quant.
Downloads · 30 days
394
4% of all-time downloads
All-time downloads
10K
Public
Parameters
31.3B
74 GB on disk
Likes
2
Public
Click a slice to open those files.
.gguf43.9 GB · 59%
How the weights are stored.
U3230.7B · 98%
From the Hugging Face model README
This is a Deckard(qx) experimental quant.
Brainwaves
arc arc/e boolq hswag obkqa piqa wino
qx86-hi 0.431,0.505,0.426,0.670,0.376,0.766,0.710
Base model
gemma-4-31B-it (Instruct)
qx86-hi 0.496,0.653,0.901,0.624,0.380,0.732,0.653
Previous model
gemma-3-27b-it-heretic
q8 0.557,0.711,0.868,0.533,0.452,0.706,0.695
As I don't have an easy way to test this until LMStudio supports it, please Like it only if you had a good experience.
Thank you,
-G