Downloads · 30 days
7
19% of all-time downloads
kyleliu789/qwen3-14b-svamp14-dpo-qlora
qwen3-14b-svamp14-dpo-qlora is a text generation model from kyleliu789. Use it when you need the model to write or continue text. It is set up for peft. The card lists the license as other.
should probably proofread and complete it, then remove this comment. --
Downloads · 30 days
7
19% of all-time downloads
All-time downloads
37
Public
Repo size
19 GB
Likes
0
Public
Click a slice to open those files.
.pt12.3 GB · 64%
From the Hugging Face model README
This model is a fine-tuned version of Qwen/Qwen3-14B on the reasonif_14b_dpo_train dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Logits/chosen | Logits/rejected | Logps/chosen | Logps/rejected | Validation Loss | Rewards/accuracies | Rewards/chosen | Rewards/margins | Rewards/rejected |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 0.1454 | 0.0765 | 50 | -2.1025 | -2.4458 | -166.2713 | -129.8090 | 0.1136 | 1.0000 | 1.2518 | 2.4998 | -1.2480 |
| 0.0022 | 0.1530 | 100 | -2.0108 | -2.2999 | -163.4206 | -177.0903 | 0.0027 | 1.0000 | 1.5369 | 7.5131 | -5.9762 |
| 0.0006 | 0.2295 | 150 | -1.9998 | -2.2790 | -164.8533 | -192.6432 | 0.0011 | 1.0000 | 1.3936 | 8.9251 | -7.5314 |
| 0.0004 | 0.3060 | 200 | -1.9936 | -2.2684 | -165.3555 | -198.5902 | 0.0008 | 1.0000 | 1.3434 | 9.4696 | -8.1261 |
| 0.0002 | 0.3826 | 250 | -1.9940 | -2.2647 | -165.8076 | -206.1508 | 0.0006 | 1.0000 | 1.2982 | 10.1804 | -8.8822 |
| 0.0002 | 0.4591 | 300 | -1.9924 | -2.2597 | -166.1216 | -209.5938 | 0.0005 | 1.0000 | 1.2668 | 10.4933 | -9.2265 |
| 0.0001 | 0.5356 | 350 | -1.9912 | -2.2566 | -166.4158 | -211.8986 | 0.0005 | 1.0000 | 1.2374 | 10.6944 | -9.4570 |
| 0.0002 | 0.6121 | 400 | -1.9931 | -2.2552 | -166.4771 | -214.0180 | 0.0004 | 1.0000 | 1.2313 | 10.9002 | -9.6689 |
| 0.0002 | 0.6886 | 450 | -1.9937 | -2.2562 | -166.6437 | -215.5471 | 0.0004 | 1.0000 | 1.2146 | 11.0364 | -9.8218 |
| 0.0002 | 0.7651 | 500 | -1.9924 | -2.2549 | -166.7090 | -216.6241 | 0.0004 | 1.0000 | 1.2081 | 11.1376 | -9.9295 |
| 0.0002 | 0.8416 | 550 | 0.0004 | 1.2014 | -9.9694 | 1.0000 | 11.1708 | -166.7757 | -217.0226 | -1.9920 | -2.2526 |
| 0.0002 | 0.9181 | 600 | 0.0004 | 1.2010 | -9.9813 | 1.0000 | 11.1823 | -166.7791 | -217.1418 | -1.9924 | -2.2530 |
| 0.0001 | 0.9946 | 650 | 0.0004 | 1.1977 | -9.9962 | 1.0000 | 11.1939 | -166.8129 | -217.2909 | -1.9912 | -2.2523 |