Downloads · 30 days
9
1% of all-time downloads
promotion/Llama-3.1-8B-NBPO-finitepool
Llama-3.1-8B-NBPO-finitepool is a text generation model from promotion. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama3.1.
Do not use this checkpoint for the UltraFeedback results in the NBPO paper. It is kept only so that the published artifact remains inspectable.
Downloads · 30 days
9
1% of all-time downloads
All-time downloads
858
Public
Parameters
8B
64.3 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors32.1 GB · 100%
From the Hugging Face model README
Do not use this checkpoint for the UltraFeedback results in the NBPO paper. It is kept only so that the published artifact remains inspectable.
An audit by prompt-text hash found that 629 of the 698 UltraFeedback evaluation prompts appear in this checkpoint's training pairs. The panel's response pool was regenerated for this campaign with prompts drawn independently of the earlier campaign from which the evaluation list was inherited, and the two collided. Every other UltraFeedback arm in the paper is prompt-disjoint from the evaluation set, so this checkpoint was the only one measured partly in sample, and the bias runs in its own favour.
promotion/Llama-3.1-8B-NBPO-UltraFeedback-clean is the same configuration retrained on pairs
filtered to be prompt-disjoint from the evaluation set (37,800 -> 34,026 training rows over 5,671
prompts). It is the checkpoint behind the paper's UltraFeedback NBPO row.