Downloads · 30 days
0
gbmpo_gsm8k_model
LLMAligned/gbmpo_gsm8k_model
gbmpo_gsm8k_model is a reinforcement learning model from LLMAligned. Use it for the reinforcement learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
This model was fine-tuned using GBMPO (Group Bound Multi-Objective Policy Optimization) on the GSM8K dataset.
Access
Public
Updated Jan 21, 2026
Repo size
28.9 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors17.5 MB · 52%
At a glance
- Task
- Reinforcement Learning
- License
- apache-2.0
- Access
- Public
- Created
- Jan 21, 2026
- Updated
- Jan 21, 2026
- SHA
- 052b6fd4
Base models
Model card
From the Hugging Face model README
GBMPO Fine-tuned Model on GSM8K
This model was fine-tuned using GBMPO (Group Bound Multi-Objective Policy Optimization) on the GSM8K dataset.
Training Details
- Base Model: Qwen/Qwen2.5-1.5B-Instruct
- Dataset: openai/gsm8k
- Algorithm: GBMPO
- Training Steps: Check training logs for details
Usage
from transformers import AutoModelForCausalLM, AutoTokenizer
model = AutoModelForCausalLM.from_pretrained("LLMAligned/gbmpo_gsm8k_model")
tokenizer = AutoTokenizer.from_pretrained("LLMAligned/gbmpo_gsm8k_model")
prompt = "Solve: What is 25 * 4?"
inputs = tokenizer(prompt, return_tensors="pt")
outputs = model.generate(**inputs, max_length=512)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))
- Task
- Reinforcement Learning
- License
- apache-2.0
- Created
- Jan 21, 2026
- Updated
- Jan 21, 2026