Downloads · 30 days
9
21% of all-time downloads
gemma-2b-grpo-500
heissanjay/gemma-2b-grpo-500
gemma-2b-grpo-500 is a machine learning model from heissanjay. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
This model was fine-tuned using GRPO with Rubrics as Rewards (RaR) to produce structured reasoning traces.
All-time downloads
42
Public
Repo size
114 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
Other114 MB · 100%
At a glance
- Access
- Public
- Created
- Dec 31, 2025
- Updated
- Dec 31, 2025
- SHA
- 9906bf75
Model card
From the Hugging Face model README
Gemma 2 2B RaR+GRPO Reasoning Model
Model Description
This model was fine-tuned using GRPO with Rubrics as Rewards (RaR) to produce structured reasoning traces.
Loading Instructions
from orbax import checkpoint as ocp
from flax import nnx
# Load LoRA parameters
checkpointer = ocp.StandardCheckpointer()
lora_params = checkpointer.restore("lora_params", target=abs_lora_state)
# Apply to base Gemma model
nnx.update(lora_policy, lora_params)
Configuration
- Base model: gemma2-2b-it
- LoRA rank: 64
- LoRA alpha: 128
- Training samples: 500
- Training steps: 112
Output Format
<reasoning>
Step-by-step thinking process
</reasoning>
<answer>
Final answer
</answer>
- Created
- Dec 31, 2025
- Updated
- Dec 31, 2025