Downloads · 30 days
45
14% of all-time downloads
Jimmy19991222/llama-3-8b-instruct-gapo-v2-rouge2-beta10-1minus-gamma0.3-rerun
llama-3-8b-instruct-gapo-v2-rouge2-beta10-1minus-gamma0.3-rerun is a text generation model from Jimmy19991222. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama3.
should probably proofread and complete it, then remove this comment. --
Downloads · 30 days
45
14% of all-time downloads
All-time downloads
333
Public
Parameters
8B
112 GB on disk
Likes
0
Public
Click a slice to open those files.
.pt96.4 GB · 75%
From the Hugging Face model README
This model is a fine-tuned version of meta-llama/Meta-Llama-3-8B-Instruct on the princeton-nlp/llama3-ultrafeedback-armorm dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss | Rewards/chosen | Rewards/rejected | Rewards/accuracies | Rewards/margins | Logps/rejected | Logps/chosen | Logits/rejected | Logits/chosen |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 1.2554 | 0.8550 | 400 | 1.2597 | -17.5481 | -23.3529 | 0.8415 | 5.8049 | -2.3353 | -1.7548 | -1.4709 | -1.4625 |