Downloads · 30 days
14
38% of all-time downloads
ASAP_FineTuningBERT_AugV10_k10_task1_organization_k10_k10_fold2
genki10/ASAP_FineTuningBERT_AugV10_k10_task1_organization_k10_k10_fold2
ASAP_FineTuningBERT_AugV10_k10_task1_organization_k10_k10_fold2 is a text classification model from genki10. Use it when you need a label for a piece of text. It is set up for transformers. The card lists the license as apache-2.0.
should probably proofread and complete it, then remove this comment. --
All-time downloads
37
Public
Repo size
33.7 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin876 MB · 100%
At a glance
- Task
- Text Classification
- Library
- transformers
- License
- apache-2.0
- Model type
- bert
- Access
- Public
- Created
- Feb 13, 2025
- Updated
- Feb 13, 2025
- SHA
- 3f3fd33c
Try a prompt
Base models
Model card
From the Hugging Face model README
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->
ASAP_FineTuningBERT_AugV10_k10_task1_organization_k10_k10_fold2
This model is a fine-tuned version of bert-base-uncased on the None dataset. It achieves the following results on the evaluation set:
- Loss: 1.2145
- Qwk: 0.3253
- Mse: 1.2149
- Rmse: 1.1022
Model description
More information needed
Intended uses & limitations
More information needed
Training and evaluation data
More information needed
Training procedure
Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 2e-05
- train_batch_size: 64
- eval_batch_size: 64
- seed: 42
- optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
- lr_scheduler_type: linear
- num_epochs: 100
Training results
| Training Loss | Epoch | Step | Validation Loss | Qwk | Mse | Rmse |
|---|---|---|---|---|---|---|
| No log | 1.0 | 8 | 7.9698 | 0.0 | 7.9701 | 2.8231 |
| No log | 2.0 | 16 | 4.3973 | 0.0 | 4.3976 | 2.0971 |
| No log | 3.0 | 24 | 1.8029 | 0.0399 | 1.8033 | 1.3429 |
| No log | 4.0 | 32 | 1.5898 | 0.0602 | 1.5903 | 1.2611 |
| No log | 5.0 | 40 | 1.6846 | 0.1437 | 1.6851 | 1.2981 |
| No log | 6.0 | 48 | 2.2355 | 0.1241 | 2.2362 | 1.4954 |
| No log | 7.0 | 56 | 1.9809 | 0.1577 | 1.9814 | 1.4076 |
| No log | 8.0 | 64 | 2.1212 | 0.1878 | 2.1219 | 1.4567 |
| No log | 9.0 | 72 | 2.2728 | 0.1546 | 2.2736 | 1.5078 |
| No log | 10.0 | 80 | 3.0356 | 0.1037 | 3.0365 | 1.7425 |
| No log | 11.0 | 88 | 2.0935 | 0.1360 | 2.0943 | 1.4472 |
| No log | 12.0 | 96 | 1.4443 | 0.2631 | 1.4449 | 1.2021 |
| No log | 13.0 | 104 | 1.5731 | 0.2196 | 1.5737 | 1.2545 |
| No log | 14.0 | 112 | 1.3823 | 0.3167 | 1.3827 | 1.1759 |
| No log | 15.0 | 120 | 1.3306 | 0.2741 | 1.3310 | 1.1537 |
| No log | 16.0 | 128 | 1.4696 | 0.2598 | 1.4703 | 1.2126 |
| No log | 17.0 | 136 | 1.6220 | 0.2344 | 1.6227 | 1.2738 |
| No log | 18.0 | 144 | 1.0940 | 0.3702 | 1.0942 | 1.0460 |
| No log | 19.0 | 152 | 1.3734 | 0.2708 | 1.3737 | 1.1720 |
| No log | 20.0 | 160 | 2.0888 | 0.2188 | 2.0893 | 1.4454 |
| No log | 21.0 | 168 | 2.0346 | 0.2144 | 2.0351 | 1.4266 |
| No log | 22.0 | 176 | 1.6492 | 0.2355 | 1.6496 | 1.2844 |
| No log | 23.0 | 184 | 1.7897 | 0.2326 | 1.7903 | 1.3380 |
| No log | 24.0 | 192 | 1.4474 | 0.2611 | 1.4478 | 1.2033 |
| No log | 25.0 | 200 | 1.5420 | 0.2779 | 1.5425 | 1.2420 |
| No log | 26.0 | 208 | 1.0615 | 0.2947 | 1.0619 | 1.0305 |
| No log | 27.0 | 216 | 1.5417 | 0.2690 | 1.5425 | 1.2420 |
| No log | 28.0 | 224 | 1.5060 | 0.2835 | 1.5068 | 1.2275 |
| No log | 29.0 | 232 | 0.9730 | 0.3418 | 0.9734 | 0.9866 |
| No log | 30.0 | 240 | 1.0490 | 0.3455 | 1.0495 | 1.0244 |
| No log | 31.0 | 248 | 1.0555 | 0.3129 | 1.0560 | 1.0276 |
| No log | 32.0 | 256 | 0.9198 | 0.3804 | 0.9203 | 0.9593 |
| No log | 33.0 | 264 | 0.9703 | 0.3555 | 0.9707 | 0.9853 |
| No log | 34.0 | 272 | 1.0547 | 0.3766 | 1.0551 | 1.0272 |
| No log | 35.0 | 280 | 1.1743 | 0.3093 | 1.1749 | 1.0839 |
| No log | 36.0 | 288 | 1.4807 | 0.2737 | 1.4813 | 1.2171 |
| No log | 37.0 | 296 | 1.1557 | 0.2944 | 1.1563 | 1.0753 |
| No log | 38.0 | 304 | 1.0294 | 0.3376 | 1.0300 | 1.0149 |
| No log | 39.0 | 312 | 0.9188 | 0.3790 | 0.9192 | 0.9588 |
| No log | 40.0 | 320 | 0.9677 | 0.3687 | 0.9682 | 0.9840 |
| No log | 41.0 | 328 | 1.1182 | 0.3241 | 1.1189 | 1.0578 |
| No log | 42.0 | 336 | 1.0474 | 0.3447 | 1.0480 | 1.0237 |
| No log | 43.0 | 344 | 0.8275 | 0.3899 | 0.8279 | 0.9099 |
| No log | 44.0 | 352 | 0.9803 | 0.3468 | 0.9808 | 0.9903 |
| No log | 45.0 | 360 | 0.9468 | 0.3895 | 0.9473 | 0.9733 |
| No log | 46.0 | 368 | 0.8734 | 0.4101 | 0.8739 | 0.9348 |
| No log | 47.0 | 376 | 0.9390 | 0.3931 | 0.9395 | 0.9693 |
| No log | 48.0 | 384 | 0.8773 | 0.4016 | 0.8777 | 0.9368 |
| No log | 49.0 | 392 | 1.0553 | 0.3175 | 1.0558 | 1.0275 |
| No log | 50.0 | 400 | 0.9406 | 0.3354 | 0.9410 | 0.9701 |
| No log | 51.0 | 408 | 1.1898 | 0.3078 | 1.1903 | 1.0910 |
| No log | 52.0 | 416 | 1.1702 | 0.2944 | 1.1706 | 1.0819 |
| No log | 53.0 | 424 | 1.1478 | 0.3204 | 1.1481 | 1.0715 |
| No log | 54.0 | 432 | 0.9224 | 0.3683 | 0.9226 | 0.9605 |
| No log | 55.0 | 440 | 0.9081 | 0.3440 | 0.9084 | 0.9531 |
| No log | 56.0 | 448 | 0.8502 | 0.3691 | 0.8505 | 0.9222 |
| No log | 57.0 | 456 | 1.1357 | 0.2992 | 1.1361 | 1.0659 |
| No log | 58.0 | 464 | 1.0904 | 0.3061 | 1.0907 | 1.0444 |
| No log | 59.0 | 472 | 1.2558 | 0.2922 | 1.2562 | 1.1208 |
| No log | 60.0 | 480 | 1.0634 | 0.3185 | 1.0638 | 1.0314 |
| No log | 61.0 | 488 | 1.0724 | 0.3183 | 1.0727 | 1.0357 |
| No log | 62.0 | 496 | 0.9149 | 0.3466 | 0.9152 | 0.9567 |
| 0.3524 | 63.0 | 504 | 1.0545 | 0.3160 | 1.0549 | 1.0271 |
| 0.3524 | 64.0 | 512 | 1.0284 | 0.3099 | 1.0287 | 1.0143 |
| 0.3524 | 65.0 | 520 | 1.1376 | 0.3112 | 1.1381 | 1.0668 |
| 0.3524 | 66.0 | 528 | 1.2145 | 0.3253 | 1.2149 | 1.1022 |
Framework versions
- Transformers 4.47.0
- Pytorch 2.5.1+cu121
- Datasets 3.2.0
- Tokenizers 0.21.0
- Task
- Text Classification
- Library
- transformers
- Type
- bert
- License
- apache-2.0
- Created
- Feb 13, 2025
- Updated
- Feb 13, 2025