Downloads · 30 days
11
2% of all-time downloads
slm-125m-rlaif
Sudhanshu1985/slm-125m-rlaif
slm-125m-rlaif is a text generation model from Sudhanshu1985. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
RLAIF (Reinforcement Learning from AI Feedback) alignment of Sudhanshu1985/slm-125m-sft. A scalar reward model (Bradley-Terry on gpt-4.1-mini preference pairs) scores on-policy samples; the policy is optimized with RL…
All-time downloads
649
Public
Parameters
126M
252 MB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors252 MB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- llama
- Access
- Public
- Created
- Aug 8, 2026
- Updated
- Aug 8, 2026
- SHA
- f01f3b9d
Try a prompt
Base models
Model card
From the Hugging Face model README
slm-125m-rlaif
RLAIF (Reinforcement Learning from AI Feedback) alignment of Sudhanshu1985/slm-125m-sft. A scalar reward model (Bradley-Terry on gpt-4.1-mini preference pairs) scores on-policy samples; the policy is optimized with RLOO policy gradient + KL to the frozen SFT. Mean reward -0.158 -> 0.155. This is the RL-based counterpart to Sudhanshu1985/slm-125m-dpo. Uses the SFT chat template: <|bos|><|system|>SYS<|user|>USER<|assistant|>ANSWER<|eos|>.
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- apache-2.0
- Languages
- en
- Created
- Aug 8, 2026
- Updated
- Aug 8, 2026