Downloads · 30 days
199
4% of all-time downloads
RichardErkhov/Ejafa_-_phi-3-mini-128k-instruct-simpo-lr-5e-07-gamma-1.5-gguf
Ejafa_-_phi-3-mini-128k-instruct-simpo-lr-5e-07-gamma-1.5-gguf is a machine learning model from RichardErkhov. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Downloads · 30 days
199
4% of all-time downloads
All-time downloads
5.2K
Public
Repo size
43.9 GB
Likes
0
Public
Click a slice to open those files.
.gguf51.1 GB · 100%
From the Hugging Face model README
Quantization made by Richard Erkhov.
phi-3-mini-128k-instruct-simpo-lr-5e-07-gamma-1.5 - GGUF
license: mit base_model: microsoft/Phi-3-mini-128k-instruct tags:
This model was trained as part of the Reinforcement Learning - 24 project at Peking University, focusing on [simpo].
This model is a fine-tuned version of microsoft/Phi-3-mini-128k-instruct on the princeton-nlp/llama3-ultrafeedback dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss | Rewards/chosen | Rewards/rejected | Rewards/accuracies | Rewards/margins | Logps/rejected | Logps/chosen | Logits/rejected | Logits/chosen |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 1.6417 | 0.8549 | 400 | 1.6236 | -2.2390 | -2.6457 | 0.6210 | 0.4067 | -1.0583 | -0.8956 | 2.0190 | 2.0146 |