Downloads · 30 days
3
13% of all-time downloads
hZzy/qwen2.5-0.5b-expo-L2EXPO-25-9
qwen2.5-0.5b-expo-L2EXPO-25-9 is a machine learning model from hZzy. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
should probably proofread and complete it, then remove this comment. --
Downloads · 30 days
3
13% of all-time downloads
All-time downloads
24
Public
Parameters
494M
2 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors2 GB · 99%
From the Hugging Face model README
This model is a fine-tuned version of hZzy/qwen2.5-0.5b-sft3-25-2 on the hZzy/direction_right2 dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss | Objective | Reward Accuracy | Logp Accuracy | Log Diff Policy | Chosen Logps | Rejected Logps | Chosen Rewards | Rejected Rewards | Logits |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 0.5613 | 0.4044 | 100 | 0.5042 | 0.4986 | 0.5699 | 0.5721 | 4.3561 | -116.5406 | -120.8967 | -0.2875 | -0.3277 | -1.6238 |
| 0.51 | 0.8089 | 200 | 0.4951 | 0.4916 | 0.5928 | 0.5755 | 7.6656 | -148.1296 | -155.7952 | -0.6034 | -0.6767 | -2.0415 |
| 0.4677 | 1.2133 | 300 | 0.4965 | 0.4962 | 0.5956 | 0.5822 | 8.3074 | -156.7594 | -165.0668 | -0.6897 | -0.7694 | -2.3321 |
| 0.4308 | 1.6178 | 400 | 0.4994 | 0.4989 | 0.6051 | 0.5805 | 8.7655 | -165.7063 | -174.4718 | -0.7792 | -0.8635 | -2.5086 |