Downloads · 30 days
0
slicelm-dpo-v2
akshan-main/slicelm-dpo-v2
slicelm-dpo-v2 is a machine learning model from akshan-main. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
this is a hands-on dpo experiment that didn't end up amazingly well since my DPO pairs weren't as big in numbers as a huge lab would make use of but I learned a lot
Access
Public
Updated Mar 10, 2026
Repo size
2.6 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.pt1.7 GB · 65%
At a glance
- Access
- Public
- Created
- Nov 29, 2025
- Updated
- Mar 10, 2026
- SHA
- 476a97b6
Model card
From the Hugging Face model README
| Epoch | Training Loss | Validation Loss | Rewards/chosen | Rewards/rejected | Rewards/accuracies | Rewards/margins | Logps/chosen | Logps/rejected | Logits/chosen | Logits/rejected |
|---|---|---|---|---|---|---|---|---|---|---|
| 1 | 0.6220 | 0.6291 | -0.7651 | -0.9942 | 0.6389 | 0.2290 | -51.33 | -53.62 | -0.5743 | -0.5584 |
| 2 | 0.2153 | 0.3662 | -1.6715 | -2.8304 | 0.8333 | 1.1588 | -60.39 | -71.98 | -0.8344 | -0.8035 |
| 3 | 0.0216 | 0.2678 | -3.9962 | -6.7451 | 0.8056 | 2.7488 | -83.64 | -111.13 | -0.9501 | -0.9175 |
| 4 | 0.0034 | 0.2886 | -7.7645 | -11.9930 | 0.8333 | 4.2285 | -121.32 | -163.61 | -0.8709 | -0.8464 |
| 5 | 0.0012 | 0.3095 | -8.7604 | -13.2704 | 0.8611 | 4.5100 | -131.28 | -176.38 | -0.8497 | -0.8267 |
this is a hands-on dpo experiment that didn't end up amazingly well since my DPO pairs weren't as big in numbers as a huge lab would make use of but I learned a lot
- Created
- Nov 29, 2025
- Updated
- Mar 10, 2026