Downloads · 30 days
0
xz-huggingface-0/llama2-13b-dpo-lora-20231205-32
llama2-13b-dpo-lora-20231205-32 is a machine learning model from xz-huggingface-0. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
should probably proofread and complete it, then remove this comment. --
Downloads · 30 days
0
Access
Public
Updated Dec 6, 2023
Repo size
210 MB
Likes
0
Public
Click a slice to open those files.
.safetensors210 MB · 99%
From the Hugging Face model README
This model is a fine-tuned version of meta-llama/Llama-2-13b-hf on the None dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss | Rewards/chosen | Rewards/rejected | Rewards/accuracies | Rewards/margins | Logps/rejected | Logps/chosen | Logits/rejected | Logits/chosen |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 0.691 | 1.0 | 121 | 0.6911 | 0.0078 | 0.0020 | 0.5040 | 0.0058 | -245.2879 | -309.4661 | -1.2040 | -1.4432 |
| 0.6895 | 2.0 | 242 | 0.6903 | 0.0202 | 0.0107 | 0.5317 | 0.0095 | -245.2007 | -309.3419 | -1.2045 | -1.4435 |
| 0.6889 | 3.0 | 363 | 0.6891 | 0.0224 | 0.0145 | 0.5675 | 0.0079 | -245.1621 | -309.3195 | -1.2044 | -1.4437 |