Downloads · 30 days
2
3% of all-time downloads
Mardiyyah/variant-tapt_grouped_llrd_grouped_txt_whole_word-LR_2e-05
variant-tapt_grouped_llrd_grouped_txt_whole_word-LR_2e-05 is a fill-mask model from Mardiyyah. Use it when you need the model to fill a missing word. It is set up for transformers. The card lists the license as mit.
should probably proofread and complete it, then remove this comment. --
Downloads · 30 days
2
3% of all-time downloads
All-time downloads
63
Public
Parameters
110M
876 MB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors438 MB · 100%
From the Hugging Face model README
This model is a fine-tuned version of microsoft/BiomedNLP-BiomedBERT-base-uncased-abstract-fulltext on the Mardiyyah/TAPT-PDBE-V1 dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss | Accuracy |
|---|---|---|---|---|
| 1.2713 | 1.0 | 18 | 1.2334 | 0.7360 |
| 1.2478 | 2.0 | 36 | 1.2452 | 0.7373 |
| 1.2361 | 3.0 | 54 | 1.2840 | 0.7276 |
| 1.227 | 4.0 | 72 | 1.2489 | 0.7336 |
| 1.2273 | 5.0 | 90 | 1.2379 | 0.7374 |
| 1.2189 | 6.0 | 108 | 1.2341 | 0.7395 |
| 1.2008 | 7.0 | 126 | 1.2131 | 0.7430 |
| 1.1735 | 8.0 | 144 | 1.1760 | 0.7436 |
| 1.1913 | 9.0 | 162 | 1.1672 | 0.7448 |
| 1.1641 | 10.0 | 180 | 1.2185 | 0.7410 |
| 1.1572 | 11.0 | 198 | 1.1713 | 0.7439 |
| 1.1657 | 12.0 | 216 | 1.1993 | 0.7397 |
| 1.1729 | 13.0 | 234 | 1.1701 | 0.7440 |
| 1.1458 | 14.0 | 252 | 1.2063 | 0.7418 |
| 1.1329 | 15.0 | 270 | 1.1803 | 0.7465 |
| 1.153 | 16.0 | 288 | 1.2014 | 0.7384 |
| 1.1537 | 17.0 | 306 | 1.1636 | 0.7446 |
| 1.1314 | 18.0 | 324 | 1.2044 | 0.7441 |
| 1.1425 | 19.0 | 342 | 1.1603 | 0.7467 |
| 1.1388 | 20.0 | 360 | 1.2132 | 0.7449 |
| 1.123 | 21.0 | 378 | 1.1853 | 0.7484 |
| 1.1148 | 22.0 | 396 | 1.1620 | 0.7514 |
| 1.1049 | 23.0 | 414 | 1.1924 | 0.7427 |
| 1.0896 | 24.0 | 432 | 1.1868 | 0.7430 |
| 1.0921 | 25.0 | 450 | 1.1818 | 0.7422 |
| 1.0916 | 26.0 | 468 | 1.1399 | 0.7524 |
| 1.0837 | 27.0 | 486 | 1.1982 | 0.7427 |
| 1.0897 | 28.0 | 504 | 1.1747 | 0.7483 |
| 1.0816 | 29.0 | 522 | 1.1992 | 0.7406 |
| 1.1019 | 30.0 | 540 | 1.2069 | 0.7356 |
| 1.0826 | 31.0 | 558 | 1.1884 | 0.7468 |
| 1.0733 | 32.0 | 576 | 1.1603 | 0.7457 |
| 1.0786 | 33.0 | 594 | 1.1583 | 0.7466 |
| 1.0921 | 34.0 | 612 | 1.1625 | 0.7474 |
| 1.0891 | 35.0 | 630 | 1.2202 | 0.7396 |
| 1.0672 | 36.0 | 648 | 1.1840 | 0.7397 |
| 1.0687 | 37.0 | 666 | 1.1688 | 0.7481 |
| 1.1061 | 38.0 | 684 | 1.1493 | 0.7460 |
| 1.0587 | 39.0 | 702 | 1.1701 | 0.7497 |
| 1.091 | 40.0 | 720 | 1.1841 | 0.7427 |
| 1.0598 | 41.0 | 738 | 1.2099 | 0.7404 |
| 1.0804 | 42.0 | 756 | 1.1938 | 0.7476 |
| 1.0659 | 43.0 | 774 | 1.2228 | 0.7381 |
| 1.0539 | 44.0 | 792 | 1.1746 | 0.7457 |
| 1.0369 | 45.0 | 810 | 1.1978 | 0.7408 |
| 1.0775 | 46.0 | 828 | 1.1610 | 0.7485 |
| 1.0724 | 47.0 | 846 | 1.1981 | 0.7404 |
| 1.057 | 48.0 | 864 | 1.1601 | 0.7487 |
| 1.0651 | 49.0 | 882 | 1.1956 | 0.7406 |
| 1.0564 | 50.0 | 900 | 1.1711 | 0.7437 |
| 1.0508 | 51.0 | 918 | 1.1384 | 0.7500 |
| 1.0475 | 52.0 | 936 | 1.2007 | 0.7462 |
| 1.0343 | 53.0 | 954 | 1.1880 | 0.7464 |
| 1.0398 | 54.0 | 972 | 1.2105 | 0.7368 |
| 1.0595 | 55.0 | 990 | 1.1978 | 0.7460 |
| 1.0507 | 56.0 | 1008 | 1.1933 | 0.7436 |
| 1.0342 | 57.0 | 1026 | 1.1905 | 0.7422 |
| 1.0515 | 58.0 | 1044 | 1.1749 | 0.7479 |
| 1.0344 | 59.0 | 1062 | 1.1880 | 0.7384 |
| 1.0197 | 60.0 | 1080 | 1.1997 | 0.7424 |
| 1.0445 | 61.0 | 1098 | 1.1995 | 0.7420 |
| 1.0305 | 62.0 | 1116 | 1.2195 | 0.7414 |
| 1.0412 | 63.0 | 1134 | 1.1830 | 0.7445 |
| 1.0219 | 64.0 | 1152 | 1.2081 | 0.7407 |
| 1.0422 | 65.0 | 1170 | 1.2016 | 0.7419 |
| 1.0496 | 66.0 | 1188 | 1.1587 | 0.7464 |
| 1.0307 | 67.0 | 1206 | 1.1845 | 0.7427 |
| 1.0405 | 68.0 | 1224 | 1.2254 | 0.7377 |
| 1.0287 | 69.0 | 1242 | 1.1957 | 0.7431 |
| 1.0118 | 70.0 | 1260 | 1.1302 | 0.7451 |
| 1.03 | 71.0 | 1278 | 1.1831 | 0.7445 |
| 1.0301 | 72.0 | 1296 | 1.1460 | 0.7523 |
| 1.025 | 73.0 | 1314 | 1.2040 | 0.7408 |
| 1.0353 | 74.0 | 1332 | 1.1758 | 0.7481 |
| 1.0435 | 75.0 | 1350 | 1.1884 | 0.7462 |
| 1.0273 | 76.0 | 1368 | 1.1725 | 0.7489 |
| 1.0139 | 77.0 | 1386 | 1.1750 | 0.7468 |
| 1.0317 | 78.0 | 1404 | 1.1800 | 0.7461 |
| 1.0242 | 79.0 | 1422 | 1.1568 | 0.7475 |
| 1.0185 | 80.0 | 1440 | 1.1856 | 0.7422 |
| 1.0185 | 81.0 | 1458 | 1.1710 | 0.7455 |
| 1.0287 | 82.0 | 1476 | 1.1837 | 0.7425 |
| 1.0267 | 83.0 | 1494 | 1.1675 | 0.7439 |
| 1.0155 | 84.0 | 1512 | 1.1850 | 0.7471 |
| 1.0163 | 85.0 | 1530 | 1.1549 | 0.7480 |
| 0.9971 | 86.0 | 1548 | 1.1991 | 0.7385 |
| 1.0104 | 87.0 | 1566 | 1.1799 | 0.7433 |
| 1.0335 | 88.0 | 1584 | 1.2050 | 0.7428 |
| 1.022 | 89.0 | 1602 | 1.2024 | 0.7438 |
| 1.0188 | 90.0 | 1620 | 1.2001 | 0.7410 |
| 1.0207 | 91.0 | 1638 | 1.1771 | 0.7469 |
| 1.0309 | 92.0 | 1656 | 1.1973 | 0.7414 |
| 1.0075 | 93.0 | 1674 | 1.1510 | 0.7485 |
| 1.014 | 94.0 | 1692 | 1.2014 | 0.7401 |
| 1.0157 | 94.4571 | 1700 | 1.1725 | 0.7476 |