Downloads · 30 days
0
just1nseo/llama31-tulu3-8b-dpo-if-rlvr-anchor-only
llama31-tulu3-8b-dpo-if-rlvr-anchor-only is a text generation model from just1nseo. Use it when you need the model to write or continue text. It is set up for transformers.
Downloads · 30 days
0
Access
Public
Updated Aug 21, 2026
Repo size
64.3 GB
Likes
0
Public
Click a slice to open those files.
.safetensors64.2 GB · 100%
From the Hugging Face model README
GRPO checkpoints exported by verl.
Every global_step_<N>/ folder is a complete bfloat16 Hugging Face model,
uploaded as soon as the trainer finished writing that step.
from transformers import AutoModelForCausalLM, AutoTokenizer
step = "global_step_455"
model = AutoModelForCausalLM.from_pretrained("just1nseo/llama31-tulu3-8b-dpo-if-rlvr-anchor-only", subfolder=step)
tokenizer = AutoTokenizer.from_pretrained("just1nseo/llama31-tulu3-8b-dpo-if-rlvr-anchor-only", subfolder=step)
allenai/Llama-3.1-Tulu-3-8B-DPOtulu3_anchor_pyx01_epoch5to6