Downloads · 30 days
6
32% of all-time downloads
hZzy/qwen2.5-0.5b-expo-L2EXPO-ES-0.01
qwen2.5-0.5b-expo-L2EXPO-ES-0.01 is a machine learning model from hZzy. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
should probably proofread and complete it, then remove this comment. --
Downloads · 30 days
6
32% of all-time downloads
All-time downloads
19
Public
Parameters
494M
11.9 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors2 GB · 99%
From the Hugging Face model README
This model is a fine-tuned version of hZzy/qwen2.5-0.5b-sft-news-IFT on the hZzy/train_pairwise dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss | Logps | Logits | Objective | Dpo Loss | Regularize | Ranking Simple | Ranking Idealized | Ranking Idealized Expo | Wo Beta |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 0.4144 | 0.1417 | 50 | 0.4116 | -92.3444 | -1.6667 | 0.4097 | 0.6906 | 0.4097 | 0.5290 | 0.8732 | 0.5321 | 17.6306 |
| 0.394 | 0.2834 | 100 | 0.4078 | -115.8757 | -2.0312 | 0.4074 | 0.6863 | 0.4074 | 0.5399 | 0.8732 | 0.5321 | 22.1058 |
| 0.3504 | 0.4251 | 150 | 0.4044 | -123.1670 | -2.0505 | 0.4018 | 0.6803 | 0.4018 | 0.5719 | 0.8732 | 0.5321 | 23.5660 |
| 0.3135 | 0.5668 | 200 | 0.4006 | -121.6031 | -2.1409 | 0.3974 | 0.6781 | 0.3974 | 0.5621 | 0.8732 | 0.5321 | 23.0977 |
| 0.2807 | 0.7085 | 250 | 0.4043 | -122.1639 | -2.3711 | 0.4010 | 0.6790 | 0.4010 | 0.5600 | 0.8732 | 0.5321 | 23.6688 |
| 0.2532 | 0.8503 | 300 | 0.3975 | -123.3866 | -2.2621 | 0.3953 | 0.6769 | 0.3953 | 0.5740 | 0.8732 | 0.5321 | 23.6726 |