Downloads · 30 days
77
5% of all-time downloads
RichardErkhov/Magpie-Align_-_Llama-3.1-8B-Magpie-Align-v0.1-RC1-gguf
Magpie-Align_-_Llama-3.1-8B-Magpie-Align-v0.1-RC1-gguf is a machine learning model from RichardErkhov. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Downloads · 30 days
77
5% of all-time downloads
All-time downloads
1.6K
Public
Repo size
97.3 GB
Likes
0
Public
Click a slice to open those files.
.gguf107 GB · 100%
From the Hugging Face model README
Quantization made by Richard Erkhov.
Llama-3.1-8B-Magpie-Align-v0.1-RC1 - GGUF
base_model: meta-llama/Meta-Llama-3.1-8B tags:
This model is a fine-tuned version of Magpie-Align/Llama-3.1-8B-Magpie-Align-SFT-v0.1 on the princeton-nlp/llama3-ultrafeedback-armorm dataset. It achieves the following results on the evaluation set:
More details will be added soon.
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss | Rewards/chosen | Rewards/rejected | Rewards/accuracies | Rewards/margins | Logps/rejected | Logps/chosen | Logits/rejected | Logits/chosen |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 0.4439 | 0.4275 | 100 | 0.4168 | -4.9964 | -6.3086 | 0.8145 | 1.3123 | -829.7151 | -704.6570 | -0.5150 | -0.5001 |
| 0.343 | 0.8549 | 200 | 0.3298 | -4.9310 | -6.7966 | 0.8952 | 1.8655 | -878.5105 | -698.1248 | -0.5776 | -0.5622 |