Downloads · 30 days
4
1% of all-time downloads
sangyon/llama31_tulu3_8b_dpo_grpo_nonthink_intentcheck_tulu3_8b_dpo
llama31_tulu3_8b_dpo_grpo_nonthink_intentcheck_tulu3_8b_dpo is a text generation model from sangyon. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama3.1.
Hugging Face-format export of the globalstep364 checkpoint from the non-reasoning Tulu IntentCheck experiment.
Downloads · 30 days
4
1% of all-time downloads
All-time downloads
322
Public
Parameters
8B
16.1 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors16.1 GB · 100%
From the Hugging Face model README
Hugging Face-format export of the global_step_364 checkpoint from the non-reasoning Tulu IntentCheck experiment.
allenai/Llama-3.1-Tulu-3-8B-DPO.0.1 when an eligible response passes IntentCheck. Non-passing responses do not receive the additional bonus.0.001.Experiment: llama31_tulu3_8b_dpo_grpo_nonthink_intentcheck_tulu3_8b_dpo_bonus01_b1024_c1_t1_2k_e4_s91_20260907b.
Final resumed training run: https://wandb.ai/ifif/verl_if_rlvr/runs/ti4r0908b
The model is subject to the Llama3.1 Community License and applicable acceptable-use policy inherited from its base model.