Downloads · 30 days
9
12% of all-time downloads
gemma-judge-preferences-v0.1
altaidevorg/gemma-judge-preferences-v0.1
gemma-judge-preferences-v0.1 is a machine learning model from altaidevorg. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
This model is a fine-tuned preference evaluation model based on unsloth/gemma-3-4b-it, trained on the prometheus-eval/Preference-Collection dataset. It is designed to perform pairwise preference comparison and alignme…
All-time downloads
76
Public
Parameters
4.3B
8.6 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors8.6 GB · 100%
Parameter types
How the weights are stored.
BF164.3B · 100%
Base models
Model card
From the Hugging Face model README
📘 Model Summary
This model is a fine-tuned preference evaluation model based on unsloth/gemma-3-4b-it, trained on the prometheus-eval/Preference-Collection dataset.
It is designed to perform pairwise preference comparison and alignment evaluation tasks, inspired by the Prometheus framework (Kim et al., 2023).
🧮 Performance Benchmark
| Model | Benchmark | Accuracy (%) (Pairwise) |
|---|---|---|
| 🟦 This model | Preference Bench | 95.6 |
| 🟨 Prometheus 2 (8×7B) (Kim et al., 2024) | Preference Bench | 90.65 |
Highlights:
- Outperforms Prometheus 2 (8×7B) by +4.95%, while being smaller in size.
- Optimized for efficiency, alignment scoring, and feedback consistency.
🧾 License
This model is released under the Apache 2.0 License.
However, because it is derived from Google’s Gemma 3, your use of this model must also comply with the Gemma Terms of Use.
By using this model, you agree to:
- Follow Google’s Gemma Model Terms of Use, including restrictions on misuse and redistribution.
- Attribute Google as the original provider of the Gemma 3 base model.
For full details, see: https://ai.google.dev/gemma/terms
- Type
- gemma3
- License
- apache-2.0
- Languages
- en
- Created
- Oct 24, 2025
- Updated
- Nov 20, 2025