Downloads · 30 days
11
11% of all-time downloads
Nimbz/sam-paech_gemma-3-12b-it-antislop_4.0bpw_H6_EXL3
sam-paech_gemma-3-12b-it-antislop_4.0bpw_H6_EXL3 is a image-text-to-text model from Nimbz. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for transformers.
EXL3 4.0bpw H6 quant (quatized with exllamav3 0.0.12)
Downloads · 30 days
11
11% of all-time downloads
All-time downloads
104
Public
Parameters
4.5B
9 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors9 GB · 100%
How the weights are stored.
I163.1B · 68%
From the Hugging Face model README
EXL3 4.0bpw H6 quant (quatized with exllamav3 0.0.12)
Original: sam-paech/gemma-3-12b-it-antislop
A fine-tune of google/gemma-3-12b-it using the antislop method described in this paper: https://arxiv.org/abs/2510.15061
The pipeline identifies the model's unique slop (over-represented words and phrases compared to human writing), generates a preference training set, and trains out the slop with our FTPO training algorithm.
https://github.com/sam-paech/auto-antislop
This process alters the model to make the most common slop words & phrases much less frequent, with minimal impact or degradation to the model.
It won't remove slop entirely. The technique only targets over-represented words & phrases, not stylistic or thematic slop.
This model should serve as a good base for further fine-tuning.