Downloads · 30 days
0
sairambokka/gemma3-1b-gsm8k-grpo-reasoning
gemma3-1b-gsm8k-grpo-reasoning is a machine learning model from sairambokka. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for flax.
This model is a LoRA fine-tuned version of google/gemma-3-1b-it on the GSM8K dataset using GRPO (Group Relative Policy Optimization).
Downloads · 30 days
0
Access
Public
Updated Dec 4, 2025
Repo size
36.2 MB
Likes
0
Public
Click a slice to open those files.
Other36.5 MB · 100%
From the Hugging Face model README
This model is a LoRA fine-tuned version of google/gemma-3-1b-it on the GSM8K dataset using GRPO (Group Relative Policy
Optimization).
This model was trained with process-based rewards to encourage reasoning:
This is a LoRA checkpoint. To use it, you'll need to:
qwix or peft# Example usage (requires tunix/qwix)
from tunix.models.gemma3 import params, model
import qwix
# Load base model
base_model = params.create_model_from_checkpoint(params.GEMMA3_1B_IT, model.ModelConfig.gemma3_1b())
# Apply LoRA (load from this checkpoint)
# ... (implementation depends on your framework)
Citation
@misc{gemma3-gsm8k-grpo,
author = {sairambokka},
title = {Gemma 3 1B Fine-tuned on GSM8K with GRPO},
year = {2024},
publisher = {HuggingFace},
howpublished = {\url{https://huggingface.co/sairambokka/gemma3-1b-gsm8k-grpo-reasoning}}
}