Downloads · 30 days
17
26% of all-time downloads
soksof/gemma-3-12b-wmt26-int4
gemma-3-12b-wmt26-int4 is a translation model from soksof. Use it when you need text moved from one language to another. It is set up for transformers. The card lists the license as gemma.
A compressed, modified derivative of google/gemma-3-12b-it for the WMT26 Model Compression shared task (constrained track). This file has been modified from the original Gemma 3 release: INT4 W4A16 (GPTQ → compressed-…
Downloads · 30 days
17
26% of all-time downloads
All-time downloads
66
Public
Parameters
2.4B
7.6 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors7.6 GB · 99%
How the weights are stored.
I3210.8B · 91%
From the Hugging Face model README
A compressed, modified derivative of google/gemma-3-12b-it for the
WMT26 Model Compression shared task (constrained track). This file has been modified from
the original Gemma 3 release: INT4 W4A16 (GPTQ → compressed-tensors), near-lossless.
google/gemma-3-12b-it (Google)vllm==0.23.0 / transformers==5.12.1 /
compressed-tensors==0.17.0. Inference entrypoint, environment, and run instructions are in
the submission package (run.sh / setup.sh / requirements.txt).Gemma is provided under and subject to the Gemma Terms of Use, found at
https://ai.google.dev/gemma/terms . Use is additionally governed by the Gemma
Prohibited Use Policy (https://ai.google.dev/gemma/prohibited_use_policy). This is a
derivative of google/gemma-3-12b-it; Gemma and its trademarks are the property of Google. By using these
weights you agree to the Gemma Terms of Use.