Downloads · 30 days
11
12% of all-time downloads
leobianco/npov_RM_google_S200898_LLM_false_STRUCT_true_epo10_lr2e-4_r8_2602261631
npov_RM_google_S200898_LLM_false_STRUCT_true_epo10_lr2e-4_r8_2602261631 is a machine learning model from leobianco. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft. The card lists the license as gemma.
should probably proofread and complete it, then remove this comment. --
Downloads · 30 days
11
12% of all-time downloads
All-time downloads
91
Public
Repo size
70.8 MB
Likes
0
Public
Click a slice to open those files.
.json34.4 MB · 82%
From the Hugging Face model README
This model is a fine-tuned version of google/gemma-2-2b-it on an unknown dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss | Roc Auc | Best Threshold | Tpr At Best Threshold | Fpr At Best Threshold | Accuracy At Best Threshold | Avg Score True Positives | Avg Score True Negatives |
|---|---|---|---|---|---|---|---|---|---|---|
| No log | 0 | 0 | 5.5312 | 0.5 | inf | 0.0 | 0.0 | 0.2041 | 0.5 | 0.5 |
| 5.4805 | 0.25 | 5 | 4.7013 | 0.6453 | 0.6079 | 0.7607 | 0.5 | 0.7075 | 0.6093 | 0.6081 |
| 5.4922 | 0.5 | 10 | 5.2438 | 0.6999 | 0.5303 | 0.6068 | 0.1667 | 0.6531 | 0.5321 | 0.5277 |
| 5.5742 | 0.75 | 15 | 5.3014 | 0.5677 | 0.5047 | 0.8718 | 0.6 | 0.7755 | 0.5245 | 0.5173 |
| 5.2734 | 1.0 | 20 | 5.8567 | 0.5249 | 0.3748 | 0.9487 | 0.7 | 0.8163 | 0.4730 | 0.4630 |
| 4.1113 | 1.25 | 25 | 3.9056 | 0.6721 | 0.5997 | 0.8291 | 0.4667 | 0.7687 | 0.7255 | 0.6146 |
| 5.5254 | 1.5 | 30 | 3.8935 | 0.8103 | 0.6809 | 0.5726 | 0.1 | 0.6395 | 0.6686 | 0.4732 |
| 3.1172 | 1.75 | 35 | 4.2940 | 0.7922 | 0.5430 | 0.7265 | 0.2667 | 0.7279 | 0.6207 | 0.3939 |
| 3.8298 | 2.0 | 40 | 10.5485 | 0.6715 | 0.0228 | 0.9744 | 0.5333 | 0.8707 | 0.3533 | 0.2488 |
| 2.4397 | 2.25 | 45 | 3.9555 | 0.8085 | 0.8791 | 0.6239 | 0.1667 | 0.6667 | 0.7911 | 0.4197 |
| 3.7251 | 2.5 | 50 | 3.0599 | 0.8430 | 0.9149 | 0.7778 | 0.1667 | 0.7891 | 0.8924 | 0.5347 |
| 3.1699 | 2.75 | 55 | 3.9720 | 0.8415 | 0.5641 | 0.7607 | 0.1667 | 0.7755 | 0.6742 | 0.2960 |
| 2.6016 | 3.0 | 60 | 2.8028 | 0.8483 | 0.7793 | 0.7350 | 0.1667 | 0.7551 | 0.8209 | 0.4130 |
| 2.663 | 3.25 | 65 | 2.6854 | 0.8684 | 0.7592 | 0.7949 | 0.2 | 0.7959 | 0.8529 | 0.3577 |
| 1.5983 | 3.5 | 70 | 2.4964 | 0.8889 | 0.9185 | 0.8462 | 0.2 | 0.8367 | 0.9404 | 0.4286 |
| 1.3358 | 3.75 | 75 | 3.1246 | 0.8944 | 0.9857 | 0.8291 | 0.1333 | 0.8367 | 0.9721 | 0.4569 |
| 1.5598 | 4.0 | 80 | 4.4686 | 0.8704 | 0.3111 | 0.9060 | 0.2667 | 0.8707 | 0.8302 | 0.2511 |
| 0.5483 | 4.25 | 85 | 3.1757 | 0.8905 | 0.9870 | 0.8632 | 0.2 | 0.8503 | 0.9623 | 0.3946 |
| 0.4383 | 4.5 | 90 | 3.7329 | 0.8689 | 0.8816 | 0.8376 | 0.2 | 0.8299 | 0.8773 | 0.2902 |
| 0.2791 | 4.75 | 95 | 4.5387 | 0.8452 | 0.9601 | 0.9915 | 0.3667 | 0.9184 | 0.9958 | 0.4980 |
| 1.1466 | 5.0 | 100 | 3.3890 | 0.8460 | 0.9607 | 0.8462 | 0.2333 | 0.8299 | 0.9412 | 0.3752 |
| 0.0291 | 5.25 | 105 | 3.7640 | 0.8476 | 0.9557 | 0.8632 | 0.2333 | 0.8435 | 0.9417 | 0.3762 |
| 0.1768 | 5.5 | 110 | 4.8330 | 0.8426 | 0.8888 | 0.9658 | 0.3333 | 0.9048 | 0.9716 | 0.3891 |
| 0.0019 | 5.75 | 115 | 6.1178 | 0.8570 | 0.9952 | 0.9658 | 0.3333 | 0.9048 | 0.9932 | 0.4504 |
| 0.0016 | 6.0 | 120 | 6.5655 | 0.8600 | 0.9999 | 0.8034 | 0.2 | 0.8027 | 0.9799 | 0.4208 |
| 0.0014 | 6.25 | 125 | 8.8723 | 0.8634 | 1.0000 | 0.9402 | 0.3 | 0.8912 | 1.0000 | 0.5064 |
| 0.03 | 6.5 | 130 | 8.6563 | 0.8570 | 1.0000 | 0.9060 | 0.2667 | 0.8707 | 0.9999 | 0.4826 |
| 0.0001 | 6.75 | 135 | 9.3301 | 0.8561 | 0.9998 | 0.7863 | 0.2 | 0.7891 | 0.9100 | 0.3759 |
| 0.0034 | 7.0 | 140 | 9.2317 | 0.8635 | 0.9996 | 0.8376 | 0.2 | 0.8299 | 0.9179 | 0.3919 |
| 0.0 | 7.25 | 145 | 8.2103 | 0.8681 | 1.0000 | 0.8462 | 0.2 | 0.8367 | 0.9906 | 0.4156 |
| 0.0 | 7.5 | 150 | 9.3544 | 0.8651 | 1.0000 | 0.9487 | 0.3 | 0.8980 | 1.0000 | 0.4685 |
| 0.0001 | 7.75 | 155 | 9.5602 | 0.8702 | 1.0000 | 0.9145 | 0.2333 | 0.8844 | 1.0000 | 0.4779 |
| 0.0007 | 8.0 | 160 | 8.9717 | 0.8749 | 1.0000 | 0.8889 | 0.2333 | 0.8639 | 1.0000 | 0.4699 |
| 0.0 | 8.25 | 165 | 8.3183 | 0.8809 | 1.0000 | 0.8889 | 0.2 | 0.8707 | 0.9995 | 0.4665 |
| 0.0 | 8.5 | 170 | 7.6198 | 0.8855 | 1.0000 | 0.8803 | 0.1667 | 0.8707 | 0.9921 | 0.4487 |
| 0.0001 | 8.75 | 175 | 7.3544 | 0.8890 | 1.0000 | 0.8803 | 0.2 | 0.8639 | 0.9911 | 0.4295 |
| 0.0001 | 9.0 | 180 | 7.3547 | 0.8886 | 1.0000 | 0.8803 | 0.2 | 0.8639 | 0.9907 | 0.4270 |
| 0.0 | 9.25 | 185 | 7.2307 | 0.8858 | 1.0000 | 0.8803 | 0.2 | 0.8639 | 0.9907 | 0.4215 |
| 0.0001 | 9.5 | 190 | 7.3028 | 0.8862 | 1.0000 | 0.8718 | 0.1667 | 0.8639 | 0.9896 | 0.4184 |
| 0.0 | 9.75 | 195 | 7.3038 | 0.8870 | 1.0000 | 0.8803 | 0.2 | 0.8639 | 0.9896 | 0.4212 |
| 0.0001 | 10.0 | 200 | 7.3009 | 0.8879 | 1.0000 | 0.8376 | 0.1333 | 0.8435 | 0.9891 | 0.4221 |