Downloads · 30 days
10
2% of all-time downloads
Sudhanshu1985/slm-500m-rlaif
slm-500m-rlaif is a text generation model from Sudhanshu1985. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
RLAIF alignment of thesreedath/slm-500m-qa. A Bradley-Terry reward model (pref-acc 0.76 on gpt-4.1-mini preference pairs) scores on-policy samples; the policy is optimized with RLOO policy gradient + KL to the frozen…
Downloads · 30 days
10
2% of all-time downloads
All-time downloads
500
Public
Parameters
518M
1 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors1 GB · 100%
From the Hugging Face model README
RLAIF alignment of thesreedath/slm-500m-qa. A Bradley-Terry reward model (pref-acc 0.76 on gpt-4.1-mini preference pairs) scores on-policy samples; the policy is optimized with RLOO policy gradient + KL to the frozen SFT. Mean reward -0.20 -> 0.10. RL-based counterpart to Sudhanshu1985/slm-500m-dpo.