Downloads · 30 days
22
16% of all-time downloads
grimjim/gemma-3-12b-it-MPOA-v2-12B
gemma-3-12b-it-MPOA-v2-12B is a image-text-to-text model from grimjim. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as gemma.
MPOA (Magnitude-Preserving Othogonalized Ablation, AKA norm-preserving biprojected abliteration) has been applied to several layers in this model, to both mlp.downproj.weight and selfattn.oproj.weight streams.
Downloads · 30 days
22
16% of all-time downloads
All-time downloads
134
Public
Parameters
12.2B
24.4 GB on disk
Likes
4
Public
Click a slice to open those files.
.safetensors24.4 GB · 100%
From the Hugging Face model README
MPOA (Magnitude-Preserving Othogonalized Ablation, AKA norm-preserving biprojected abliteration) has been applied to several layers in this model, to both mlp.down_proj.weight and self_attn.o_proj.weight streams.
Compliance was not maximized for this model. The model appears to be near an edge of chaos with regard to some safety refusals, which should be suitable for varied text completion.
The harmless/baseline set used contains Chinese, English, and French prompts; the harmful/contrast set contains Chinese, English, and French prompts. English text generation remains coherent.