Downloads · 30 days
21
2% of all-time downloads
gemma-3-12b-it-antislop
sam-paech/gemma-3-12b-it-antislop
gemma-3-12b-it-antislop is a machine learning model from sam-paech. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
A fine-tune of google/gemma-3-12b-it using the antislop method described in this paper: https://arxiv.org/abs/2510.15061
All-time downloads
1.3K
Public
Parameters
12.2B
48.8 GB on disk
Likes
6
Public
Repo makeup
Click a slice to open those files.
.safetensors24.4 GB · 100%
At a glance
- Model type
- gemma3
- Access
- Public
- Created
- Jun 27, 2025
- Updated
- Oct 25, 2025
- SHA
- 0a36c9f0
Model card
From the Hugging Face model README
A fine-tune of google/gemma-3-12b-it using the antislop method described in this paper: https://arxiv.org/abs/2510.15061
The pipeline identifies the model's unique slop (over-represented words and phrases compared to human writing), generates a preference training set, and trains out the slop with our FTPO training algorithm.
https://github.com/sam-paech/auto-antislop
This process alters the model to make the most common slop words & phrases much less frequent, with minimal impact or degradation to the model.
It won't remove slop entirely. The technique only targets over-represented words & phrases, not stylistic or thematic slop.
This model should serve as a good base for further fine-tuning.
- Type
- gemma3
- Created
- Jun 27, 2025
- Updated
- Oct 25, 2025