Downloads · 30 days
13
24% of all-time downloads
DIR-Llama3.1-8B-RM
SilverStRock/DIR-Llama3.1-8B-RM
DIR-Llama3.1-8B-RM is a text classification model from SilverStRock. Use it when you need a label for a piece of text. It is set up for transformers. The card lists the license as llama3.1.
This repository contains the debiased reward model checkpoint used in the DIR reproduction workspace.
All-time downloads
55
Public
Parameters
7.5B
15 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors15 GB · 100%
At a glance
- Task
- Text Classification
- Library
- transformers
- License
- llama3.1
- Model type
- llama
- Access
- Public
- Created
- May 18, 2026
- Updated
- May 18, 2026
- SHA
- 5aad0d08
Try a prompt
Base models
Model card
From the Hugging Face model README
DIR Llama-3.1-8B Reward Model
This repository contains the debiased reward model checkpoint used in the DIR reproduction workspace.
- Base model:
Meta-Llama-3.1-8B-Instruct - Training data:
Skywork-Reward-Preference-80K-v0.2 - DIR checkpoint:
checkpoint-601 - RM-Bench during training:
eval_RMBench_total ~= 0.68493 - Original server path:
/data03/shibingkang/DIR/reward_models/my_outputs/Meta-Llama-3.1-8B-Instruct_DB_Difference-1_from-SK-v0.2_Debias-Tasklength_difference-1.0_len4096_fulltrain_2e-06_dataSkywork-Reward-Preference-80K-v0.2/checkpoint-601
The upload intentionally excludes DeepSpeed optimizer/model-state recovery files under global_step601/.
Those files are very large and are not needed for loading the reward model for evaluation or PPO reward scoring.
Associated code and reproduction notes: https://github.com/BingkangShi/DIR-reproduction
- Task
- Text Classification
- Library
- transformers
- Type
- llama
- License
- llama3.1
- Languages
- en
- Created
- May 18, 2026
- Updated
- May 18, 2026