Downloads · 30 days
0
xz-huggingface-0/llama2-7b-dpo-lora-20231129-52
llama2-7b-dpo-lora-20231129-52 is a machine learning model from xz-huggingface-0. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
should probably proofread and complete it, then remove this comment. --
Downloads · 30 days
0
Access
Public
Updated Nov 30, 2023
Repo size
135 MB
Likes
0
Public
Click a slice to open those files.
.safetensors134 MB · 98%
From the Hugging Face model README
This model is a fine-tuned version of meta-llama/Llama-2-7b-hf on the None dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss | Rewards/chosen | Rewards/rejected | Rewards/accuracies | Rewards/margins | Logps/rejected | Logps/chosen | Logits/rejected | Logits/chosen |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 0.6911 | 1.0 | 121 | 0.6918 | 0.0084 | 0.0083 | 0.5238 | 0.0001 | -288.7494 | -360.1742 | -0.3206 | -0.1740 |
| 0.6892 | 2.0 | 242 | 0.6888 | 0.0170 | 0.0139 | 0.4841 | 0.0032 | -288.6942 | -360.0880 | -0.3202 | -0.1740 |
| 0.6867 | 3.0 | 363 | 0.6869 | 0.0289 | 0.0137 | 0.5675 | 0.0152 | -288.6960 | -359.9693 | -0.3198 | -0.1736 |