Downloads · 30 days
19
13% of all-time downloads
zhezi12138/llama-3b-iter-1
llama-3b-iter-1 is a machine learning model from zhezi12138. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
This model is for the reproduction of results on Iterative-Prompt dataset of paper "The crucial role of samplers in online direct preference optimization". You can download it and save it as "models/rlhflowiter1", and…
Downloads · 30 days
19
13% of all-time downloads
All-time downloads
147
Public
Parameters
3.4B
6.9 GB on disk
Likes
1
Public
Click a slice to open those files.
.safetensors6.9 GB · 100%
From the Hugging Face model README
This model is for the reproduction of results on Iterative-Prompt dataset of paper "The crucial role of samplers in online direct preference optimization". You can download it and save it as "models/rlhflow_iter1", and then start the training pipeline.