Downloads · 30 days
2
7% of all-time downloads
BERT_V8_sp10_lw40_ex50_lo100_k5_k5_fold1
genki10/BERT_V8_sp10_lw40_ex50_lo100_k5_k5_fold1
BERT_V8_sp10_lw40_ex50_lo100_k5_k5_fold1 is a text classification model from genki10. Use it when you need a label for a piece of text. It is set up for transformers. The card lists the license as apache-2.0.
should probably proofread and complete it, then remove this comment. --
All-time downloads
29
Public
Repo size
29.8 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin876 MB · 100%
At a glance
- Task
- Text Classification
- Library
- transformers
- License
- apache-2.0
- Model type
- bert
- Access
- Public
- Created
- Apr 26, 2025
- Updated
- Apr 26, 2025
- SHA
- 1169abec
Try a prompt
Base models
Model card
From the Hugging Face model README
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->
BERT_V8_sp10_lw40_ex50_lo100_k5_k5_fold1
This model is a fine-tuned version of bert-base-uncased on the None dataset. It achieves the following results on the evaluation set:
- Loss: 1.9148
- Qwk: 0.0767
- Mse: 1.9123
- Rmse: 1.3829
Model description
More information needed
Intended uses & limitations
More information needed
Training and evaluation data
More information needed
Training procedure
Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 2e-05
- train_batch_size: 64
- eval_batch_size: 64
- seed: 42
- optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
- lr_scheduler_type: linear
- num_epochs: 100
Training results
| Training Loss | Epoch | Step | Validation Loss | Qwk | Mse | Rmse |
|---|---|---|---|---|---|---|
| No log | 1.0 | 4 | 8.4876 | 0.0037 | 8.4849 | 2.9129 |
| No log | 2.0 | 8 | 6.1057 | 0.0 | 6.1035 | 2.4705 |
| No log | 3.0 | 12 | 5.7444 | -0.0157 | 5.7422 | 2.3963 |
| No log | 4.0 | 16 | 4.8563 | 0.0 | 4.8542 | 2.2032 |
| No log | 5.0 | 20 | 3.6221 | 0.0 | 3.6202 | 1.9027 |
| No log | 6.0 | 24 | 2.5233 | 0.0 | 2.5215 | 1.5879 |
| No log | 7.0 | 28 | 1.6558 | 0.0506 | 1.6542 | 1.2862 |
| No log | 8.0 | 32 | 1.2669 | 0.0276 | 1.2655 | 1.1249 |
| No log | 9.0 | 36 | 1.2511 | -0.1317 | 1.2495 | 1.1178 |
| No log | 10.0 | 40 | 0.8589 | 0.2141 | 0.8577 | 0.9261 |
| No log | 11.0 | 44 | 1.2104 | 0.0340 | 1.2090 | 1.0995 |
| No log | 12.0 | 48 | 0.9043 | 0.0663 | 0.9031 | 0.9503 |
| No log | 13.0 | 52 | 2.8572 | 0.0113 | 2.8550 | 1.6897 |
| No log | 14.0 | 56 | 1.8956 | 0.0836 | 1.8933 | 1.3760 |
| No log | 15.0 | 60 | 0.8708 | 0.1707 | 0.8697 | 0.9326 |
| No log | 16.0 | 64 | 1.3123 | 0.0930 | 1.3106 | 1.1448 |
| No log | 17.0 | 68 | 1.3362 | 0.1678 | 1.3343 | 1.1551 |
| No log | 18.0 | 72 | 1.4423 | 0.1433 | 1.4402 | 1.2001 |
| No log | 19.0 | 76 | 1.3912 | 0.1406 | 1.3892 | 1.1787 |
| No log | 20.0 | 80 | 1.9986 | 0.0654 | 1.9964 | 1.4129 |
| No log | 21.0 | 84 | 1.2872 | 0.2431 | 1.2858 | 1.1339 |
| No log | 22.0 | 88 | 1.6022 | 0.1582 | 1.6001 | 1.2650 |
| No log | 23.0 | 92 | 1.4466 | 0.2000 | 1.4447 | 1.2020 |
| No log | 24.0 | 96 | 1.0398 | 0.3471 | 1.0390 | 1.0193 |
| No log | 25.0 | 100 | 1.9248 | 0.1229 | 1.9227 | 1.3866 |
| No log | 26.0 | 104 | 1.0452 | 0.3505 | 1.0443 | 1.0219 |
| No log | 27.0 | 108 | 1.6441 | 0.1452 | 1.6422 | 1.2815 |
| No log | 28.0 | 112 | 1.1194 | 0.3092 | 1.1184 | 1.0575 |
| No log | 29.0 | 116 | 1.8822 | 0.1090 | 1.8800 | 1.3711 |
| No log | 30.0 | 120 | 1.2874 | 0.2608 | 1.2858 | 1.1340 |
| No log | 31.0 | 124 | 1.1698 | 0.2893 | 1.1684 | 1.0809 |
| No log | 32.0 | 128 | 2.5703 | 0.0665 | 2.5676 | 1.6024 |
| No log | 33.0 | 132 | 1.8032 | 0.1443 | 1.8010 | 1.3420 |
| No log | 34.0 | 136 | 0.8934 | 0.3804 | 0.8925 | 0.9447 |
| No log | 35.0 | 140 | 1.8427 | 0.1238 | 1.8404 | 1.3566 |
| No log | 36.0 | 144 | 0.9949 | 0.3045 | 0.9938 | 0.9969 |
| No log | 37.0 | 148 | 1.5165 | 0.1763 | 1.5144 | 1.2306 |
| No log | 38.0 | 152 | 1.0897 | 0.2780 | 1.0885 | 1.0433 |
| No log | 39.0 | 156 | 2.2891 | 0.0648 | 2.2865 | 1.5121 |
| No log | 40.0 | 160 | 1.3239 | 0.2204 | 1.3222 | 1.1499 |
| No log | 41.0 | 164 | 1.5142 | 0.1894 | 1.5123 | 1.2298 |
| No log | 42.0 | 168 | 1.6669 | 0.1405 | 1.6649 | 1.2903 |
| No log | 43.0 | 172 | 1.2246 | 0.2539 | 1.2231 | 1.1059 |
| No log | 44.0 | 176 | 1.2884 | 0.2248 | 1.2867 | 1.1343 |
| No log | 45.0 | 180 | 1.5157 | 0.1776 | 1.5137 | 1.2303 |
| No log | 46.0 | 184 | 1.6444 | 0.1493 | 1.6422 | 1.2815 |
| No log | 47.0 | 188 | 1.5417 | 0.1766 | 1.5395 | 1.2408 |
| No log | 48.0 | 192 | 1.5332 | 0.1745 | 1.5310 | 1.2373 |
| No log | 49.0 | 196 | 1.2703 | 0.2161 | 1.2686 | 1.1263 |
| No log | 50.0 | 200 | 1.7788 | 0.0919 | 1.7763 | 1.3328 |
| No log | 51.0 | 204 | 1.3202 | 0.1752 | 1.3183 | 1.1482 |
| No log | 52.0 | 208 | 1.8056 | 0.0839 | 1.8030 | 1.3428 |
| No log | 53.0 | 212 | 1.3689 | 0.1444 | 1.3668 | 1.1691 |
| No log | 54.0 | 216 | 1.2020 | 0.2390 | 1.2003 | 1.0956 |
| No log | 55.0 | 220 | 2.0884 | 0.0554 | 2.0856 | 1.4442 |
| No log | 56.0 | 224 | 1.1874 | 0.2486 | 1.1860 | 1.0891 |
| No log | 57.0 | 228 | 1.5390 | 0.1606 | 1.5368 | 1.2397 |
| No log | 58.0 | 232 | 2.2611 | 0.0531 | 2.2584 | 1.5028 |
| No log | 59.0 | 236 | 1.0242 | 0.2533 | 1.0229 | 1.0114 |
| No log | 60.0 | 240 | 0.9796 | 0.2869 | 0.9785 | 0.9892 |
| No log | 61.0 | 244 | 1.8879 | 0.0966 | 1.8853 | 1.3731 |
| No log | 62.0 | 248 | 1.5669 | 0.1471 | 1.5646 | 1.2509 |
| No log | 63.0 | 252 | 1.1551 | 0.2357 | 1.1536 | 1.0741 |
| No log | 64.0 | 256 | 1.9148 | 0.0767 | 1.9123 | 1.3829 |
Framework versions
- Transformers 4.51.1
- Pytorch 2.5.1+cu124
- Datasets 3.5.0
- Tokenizers 0.21.0
- Task
- Text Classification
- Library
- transformers
- Type
- bert
- License
- apache-2.0
- Created
- Apr 26, 2025
- Updated
- Apr 26, 2025