Downloads · 30 days
2
4% of all-time downloads
leobianco/bosch_RM_mistralai_S130798_LLM_false_STRUCT_true_epo5_lr5e-5_r8_2602051430
bosch_RM_mistralai_S130798_LLM_false_STRUCT_true_epo5_lr5e-5_r8_2602051430 is a machine learning model from leobianco. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft. The card lists the license as apache-2.0.
should probably proofread and complete it, then remove this comment. --
Downloads · 30 days
2
4% of all-time downloads
All-time downloads
45
Public
Repo size
34.8 MB
Likes
0
Public
Click a slice to open those files.
.safetensors6.8 MB · 61%
From the Hugging Face model README
This model is a fine-tuned version of mistralai/Mistral-7B-Instruct-v0.3 on an unknown dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss | Roc Auc | Best Threshold | Tpr At Best Threshold | Fpr At Best Threshold | Accuracy At Best Threshold | Avg Score True Positives | Avg Score True Negatives |
|---|---|---|---|---|---|---|---|---|---|---|
| No log | 0 | 0 | 79.1626 | 0.5855 | 0.0000 | 0.7887 | 0.6136 | 0.6935 | 0.2545 | 0.1752 |
| 75.7108 | 0.0820 | 5 | 76.1178 | 0.5896 | 0.0000 | 0.7746 | 0.5909 | 0.6882 | 0.2778 | 0.1880 |
| 67.2305 | 0.1639 | 10 | 59.2361 | 0.5976 | 0.0000 | 0.7746 | 0.5909 | 0.6882 | 0.3838 | 0.2601 |
| 37.5157 | 0.2459 | 15 | 35.7259 | 0.6219 | 0.0017 | 0.7958 | 0.5682 | 0.7097 | 0.6303 | 0.5048 |
| 61.6406 | 0.3279 | 20 | 28.9843 | 0.6327 | 0.3630 | 0.8803 | 0.6364 | 0.7581 | 0.8551 | 0.6343 |
| 168.0 | 0.4098 | 25 | 31.0429 | 0.6251 | 0.9999 | 0.8239 | 0.5227 | 0.7419 | 0.9268 | 0.7209 |
| 59.6904 | 0.4918 | 30 | 26.7434 | 0.6573 | 0.1097 | 0.8451 | 0.5682 | 0.7473 | 0.7861 | 0.5370 |
| 29.6077 | 0.5738 | 35 | 28.0794 | 0.6701 | 0.0082 | 0.8310 | 0.5455 | 0.7419 | 0.7096 | 0.4812 |
| 40.0007 | 0.6557 | 40 | 28.4325 | 0.6785 | 0.0001 | 0.9225 | 0.5909 | 0.8011 | 0.6993 | 0.4733 |
| 8.8164 | 0.7377 | 45 | 28.0067 | 0.6788 | 0.0004 | 0.8944 | 0.5227 | 0.7957 | 0.6720 | 0.4443 |
| 27.75 | 0.8197 | 50 | 24.6941 | 0.6800 | 0.0331 | 0.8803 | 0.5227 | 0.7849 | 0.7961 | 0.5008 |
| 44.3672 | 0.9016 | 55 | 26.0747 | 0.6803 | 0.0034 | 0.8873 | 0.5227 | 0.7903 | 0.7475 | 0.4858 |
| 29.3754 | 0.9836 | 60 | 32.7528 | 0.6675 | 0.0000 | 0.8592 | 0.5227 | 0.7688 | 0.6267 | 0.3655 |
| 25.8064 | 1.0656 | 65 | 23.5148 | 0.6966 | 0.0167 | 0.9085 | 0.5227 | 0.8065 | 0.8049 | 0.4910 |
| 15.0167 | 1.1475 | 70 | 24.1071 | 0.6913 | 0.0110 | 0.8803 | 0.5227 | 0.7849 | 0.7636 | 0.4526 |
| 24.1466 | 1.2295 | 75 | 30.1442 | 0.6920 | 0.0039 | 0.7887 | 0.4318 | 0.7366 | 0.6063 | 0.3755 |
| 59.8488 | 1.3115 | 80 | 38.6673 | 0.6957 | 0.0000 | 0.8380 | 0.4773 | 0.7634 | 0.4855 | 0.3034 |
| 0.0231 | 1.3934 | 85 | 21.7832 | 0.7129 | 0.6132 | 0.8521 | 0.4545 | 0.7796 | 0.8409 | 0.5007 |
| 17.5547 | 1.4754 | 90 | 23.3736 | 0.7222 | 0.9919 | 0.8521 | 0.4773 | 0.7742 | 0.8916 | 0.6243 |
| 2.2539 | 1.5574 | 95 | 36.4352 | 0.7046 | 0.0004 | 0.7606 | 0.4318 | 0.7151 | 0.5598 | 0.2892 |
| 7.0268 | 1.6393 | 100 | 49.4011 | 0.6964 | 0.0000 | 0.7324 | 0.3409 | 0.7151 | 0.4384 | 0.2671 |
| 0.0025 | 1.7213 | 105 | 24.9446 | 0.7260 | 0.0467 | 0.8521 | 0.4773 | 0.7742 | 0.7743 | 0.4395 |
| 6.931 | 1.8033 | 110 | 23.8861 | 0.7402 | 1.0000 | 0.6549 | 0.2273 | 0.6828 | 0.8752 | 0.5384 |
| 7.1777 | 1.8852 | 115 | 23.3122 | 0.7454 | 1.0000 | 0.6338 | 0.2045 | 0.6720 | 0.8920 | 0.5392 |
| 13.6447 | 1.9672 | 120 | 21.7766 | 0.7441 | 1.0000 | 0.6690 | 0.25 | 0.6882 | 0.8610 | 0.5122 |
| 4.7813 | 2.0492 | 125 | 22.3907 | 0.7424 | 0.9996 | 0.5775 | 0.1818 | 0.6344 | 0.7614 | 0.4218 |
| 0.0002 | 2.1311 | 130 | 21.5194 | 0.7477 | 0.9997 | 0.6761 | 0.25 | 0.6935 | 0.7935 | 0.4654 |
| 4.444 | 2.2131 | 135 | 22.3548 | 0.7382 | 0.9997 | 0.6268 | 0.2273 | 0.6613 | 0.7637 | 0.4454 |
| 1.0703 | 2.2951 | 140 | 21.6606 | 0.7356 | 0.9999 | 0.6831 | 0.2727 | 0.6935 | 0.8234 | 0.5048 |
| 0.0233 | 2.3770 | 145 | 23.7328 | 0.7339 | 0.9986 | 0.6338 | 0.2273 | 0.6667 | 0.7542 | 0.4249 |
| 0.0543 | 2.4590 | 150 | 38.7888 | 0.7238 | 0.0596 | 0.6268 | 0.25 | 0.6559 | 0.5253 | 0.2191 |
| 1.3239 | 2.5410 | 155 | 30.6664 | 0.7249 | 0.2568 | 0.6761 | 0.2955 | 0.6828 | 0.6392 | 0.2970 |
| 6.625 | 2.6230 | 160 | 23.4325 | 0.7330 | 1.0000 | 0.6549 | 0.2273 | 0.6828 | 0.8444 | 0.5574 |
| 5.6169 | 2.7049 | 165 | 23.8828 | 0.7420 | 1.0000 | 0.7113 | 0.2727 | 0.7151 | 0.8754 | 0.5812 |
| 0.0028 | 2.7869 | 170 | 23.6836 | 0.7408 | 1.0000 | 0.6831 | 0.25 | 0.6989 | 0.8344 | 0.5274 |
| 25.4336 | 2.8689 | 175 | 23.8397 | 0.7449 | 1.0000 | 0.6620 | 0.25 | 0.6828 | 0.8583 | 0.5490 |
| 7.2188 | 2.9508 | 180 | 23.3797 | 0.7385 | 1.0000 | 0.6479 | 0.2045 | 0.6828 | 0.8333 | 0.5008 |
| 0.0 | 3.0328 | 185 | 24.3747 | 0.7241 | 0.9993 | 0.6268 | 0.2273 | 0.6613 | 0.7484 | 0.4169 |
| 0.0 | 3.1148 | 190 | 26.7360 | 0.7264 | 0.9945 | 0.6408 | 0.25 | 0.6667 | 0.7223 | 0.4000 |
| 6.2502 | 3.1967 | 195 | 25.2061 | 0.7360 | 1.0000 | 0.6268 | 0.2045 | 0.6667 | 0.7794 | 0.4417 |
| 0.0001 | 3.2787 | 200 | 24.6079 | 0.7421 | 1.0000 | 0.6408 | 0.2273 | 0.6720 | 0.8615 | 0.5176 |
| 0.0001 | 3.3607 | 205 | 24.4141 | 0.7529 | 1.0000 | 0.6479 | 0.2273 | 0.6774 | 0.8592 | 0.5123 |
| 0.0014 | 3.4426 | 210 | 24.4991 | 0.7486 | 1.0000 | 0.6620 | 0.2273 | 0.6882 | 0.8267 | 0.4878 |
| 0.0063 | 3.5246 | 215 | 24.6277 | 0.7466 | 0.9999 | 0.6549 | 0.2273 | 0.6828 | 0.8050 | 0.4566 |
| 0.0003 | 3.6066 | 220 | 25.2248 | 0.7448 | 0.9999 | 0.6549 | 0.2273 | 0.6828 | 0.7818 | 0.4300 |
| 0.097 | 3.6885 | 225 | 24.2544 | 0.7502 | 1.0000 | 0.6479 | 0.2273 | 0.6774 | 0.8307 | 0.4769 |
| 0.0 | 3.7705 | 230 | 23.9737 | 0.7361 | 1.0000 | 0.6549 | 0.2273 | 0.6828 | 0.8637 | 0.5060 |
| 0.0004 | 3.8525 | 235 | 24.2145 | 0.7432 | 1.0000 | 0.6690 | 0.25 | 0.6882 | 0.8803 | 0.5306 |
| 0.0 | 3.9344 | 240 | 23.8331 | 0.7477 | 1.0000 | 0.6761 | 0.25 | 0.6935 | 0.8747 | 0.5113 |
| 0.0007 | 4.0164 | 245 | 23.6153 | 0.7428 | 1.0000 | 0.6690 | 0.25 | 0.6882 | 0.8665 | 0.5030 |
| 0.0203 | 4.0984 | 250 | 23.7095 | 0.7342 | 1.0000 | 0.6620 | 0.25 | 0.6828 | 0.8594 | 0.4883 |
| 0.0 | 4.1803 | 255 | 23.7028 | 0.7382 | 1.0000 | 0.6408 | 0.2273 | 0.6720 | 0.8575 | 0.4889 |
| 0.0 | 4.2623 | 260 | 23.9105 | 0.7439 | 1.0000 | 0.6549 | 0.25 | 0.6774 | 0.8561 | 0.4910 |
| 0.0042 | 4.3443 | 265 | 23.6812 | 0.7381 | 1.0000 | 0.6620 | 0.25 | 0.6828 | 0.8520 | 0.4864 |
| 0.0 | 4.4262 | 270 | 23.8731 | 0.7463 | 1.0000 | 0.6479 | 0.2273 | 0.6774 | 0.8516 | 0.4846 |
| 0.0001 | 4.5082 | 275 | 23.7557 | 0.7462 | 1.0000 | 0.6620 | 0.25 | 0.6828 | 0.8485 | 0.4860 |
| 0.0012 | 4.5902 | 280 | 23.6139 | 0.7452 | 1.0000 | 0.6549 | 0.25 | 0.6774 | 0.8473 | 0.4837 |
| 0.0 | 4.6721 | 285 | 23.7013 | 0.7399 | 1.0000 | 0.6549 | 0.2273 | 0.6828 | 0.8503 | 0.4868 |
| 33.5 | 4.7541 | 290 | 23.7834 | 0.7380 | 1.0000 | 0.6408 | 0.2273 | 0.6720 | 0.8495 | 0.4874 |
| 0.0 | 4.8361 | 295 | 23.8841 | 0.7454 | 1.0000 | 0.6549 | 0.25 | 0.6774 | 0.8499 | 0.4821 |
| 17.6269 | 4.9180 | 300 | 23.8789 | 0.7394 | 1.0000 | 0.6620 | 0.25 | 0.6828 | 0.8474 | 0.4870 |
| 0.0 | 5.0 | 305 | 23.5565 | 0.7414 | 1.0000 | 0.6338 | 0.2273 | 0.6667 | 0.8518 | 0.4867 |