Downloads · 30 days
12
18% of all-time downloads
genki10/BERT_V8_sp10_lw20_ex200_lo50_k1_k1_fold4
BERT_V8_sp10_lw20_ex200_lo50_k1_k1_fold4 is a text classification model from genki10. Use it when you need a label for a piece of text. It is set up for transformers. The card lists the license as apache-2.0.
should probably proofread and complete it, then remove this comment. --
Downloads · 30 days
12
18% of all-time downloads
All-time downloads
68
Public
Repo size
23.7 GB
Likes
0
Public
Click a slice to open those files.
.bin876 MB · 100%
From the Hugging Face model README
This model is a fine-tuned version of bert-base-uncased on the None dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss | Qwk | Mse | Rmse |
|---|---|---|---|---|---|---|
| No log | 1.0 | 1 | 12.1497 | -0.0059 | 12.1497 | 3.4856 |
| No log | 2.0 | 2 | 10.8330 | -0.0086 | 10.8330 | 3.2913 |
| No log | 3.0 | 3 | 9.5179 | 0.0018 | 9.5179 | 3.0851 |
| No log | 4.0 | 4 | 8.5610 | 0.0018 | 8.5610 | 2.9259 |
| No log | 5.0 | 5 | 7.6229 | 0.0018 | 7.6229 | 2.7610 |
| No log | 6.0 | 6 | 6.7340 | 0.0018 | 6.7340 | 2.5950 |
| No log | 7.0 | 7 | 6.0983 | 0.0029 | 6.0983 | 2.4695 |
| No log | 8.0 | 8 | 5.3877 | 0.0245 | 5.3877 | 2.3211 |
| No log | 9.0 | 9 | 4.6798 | 0.0118 | 4.6798 | 2.1633 |
| No log | 10.0 | 10 | 4.1473 | 0.0118 | 4.1473 | 2.0365 |
| No log | 11.0 | 11 | 3.6552 | 0.0040 | 3.6552 | 1.9119 |
| No log | 12.0 | 12 | 3.2677 | 0.0040 | 3.2677 | 1.8077 |
| No log | 13.0 | 13 | 2.8656 | 0.0040 | 2.8656 | 1.6928 |
| No log | 14.0 | 14 | 2.5267 | 0.0038 | 2.5267 | 1.5896 |
| No log | 15.0 | 15 | 2.2552 | 0.1848 | 2.2552 | 1.5017 |
| No log | 16.0 | 16 | 2.0130 | 0.0783 | 2.0130 | 1.4188 |
| No log | 17.0 | 17 | 1.8156 | 0.0470 | 1.8156 | 1.3474 |
| No log | 18.0 | 18 | 1.6255 | 0.0445 | 1.6255 | 1.2750 |
| No log | 19.0 | 19 | 1.4767 | 0.0445 | 1.4767 | 1.2152 |
| No log | 20.0 | 20 | 1.3524 | 0.0445 | 1.3524 | 1.1629 |
| No log | 21.0 | 21 | 1.2256 | 0.0420 | 1.2256 | 1.1071 |
| No log | 22.0 | 22 | 1.1163 | 0.0316 | 1.1163 | 1.0566 |
| No log | 23.0 | 23 | 1.0266 | 0.0316 | 1.0266 | 1.0132 |
| No log | 24.0 | 24 | 0.9490 | 0.0420 | 0.9490 | 0.9742 |
| No log | 25.0 | 25 | 0.8829 | 0.0420 | 0.8829 | 0.9396 |
| No log | 26.0 | 26 | 0.8165 | 0.3015 | 0.8165 | 0.9036 |
| No log | 27.0 | 27 | 0.7703 | 0.4236 | 0.7703 | 0.8777 |
| No log | 28.0 | 28 | 0.7154 | 0.4926 | 0.7154 | 0.8458 |
| No log | 29.0 | 29 | 0.6808 | 0.5108 | 0.6808 | 0.8251 |
| No log | 30.0 | 30 | 0.6401 | 0.4972 | 0.6401 | 0.8000 |
| No log | 31.0 | 31 | 0.6048 | 0.5350 | 0.6048 | 0.7777 |
| No log | 32.0 | 32 | 0.5847 | 0.5707 | 0.5847 | 0.7647 |
| No log | 33.0 | 33 | 0.5681 | 0.5898 | 0.5681 | 0.7537 |
| No log | 34.0 | 34 | 0.5414 | 0.5198 | 0.5414 | 0.7358 |
| No log | 35.0 | 35 | 0.5235 | 0.5513 | 0.5235 | 0.7235 |
| No log | 36.0 | 36 | 0.5276 | 0.5445 | 0.5276 | 0.7264 |
| No log | 37.0 | 37 | 0.5063 | 0.5674 | 0.5063 | 0.7115 |
| No log | 38.0 | 38 | 0.5060 | 0.5830 | 0.5060 | 0.7113 |
| No log | 39.0 | 39 | 0.5083 | 0.5506 | 0.5083 | 0.7130 |
| No log | 40.0 | 40 | 0.5265 | 0.5394 | 0.5265 | 0.7256 |
| No log | 41.0 | 41 | 0.4902 | 0.5737 | 0.4902 | 0.7001 |
| No log | 42.0 | 42 | 0.5061 | 0.6077 | 0.5061 | 0.7114 |
| No log | 43.0 | 43 | 0.4842 | 0.6161 | 0.4842 | 0.6958 |
| No log | 44.0 | 44 | 0.5199 | 0.5868 | 0.5199 | 0.7210 |
| No log | 45.0 | 45 | 0.5243 | 0.5970 | 0.5243 | 0.7241 |
| No log | 46.0 | 46 | 0.4812 | 0.6118 | 0.4812 | 0.6937 |
| No log | 47.0 | 47 | 0.4835 | 0.6083 | 0.4835 | 0.6954 |
| No log | 48.0 | 48 | 0.5233 | 0.6095 | 0.5233 | 0.7234 |
| No log | 49.0 | 49 | 0.5202 | 0.6088 | 0.5202 | 0.7213 |
| No log | 50.0 | 50 | 0.4994 | 0.6035 | 0.4994 | 0.7067 |
| No log | 51.0 | 51 | 0.5061 | 0.6045 | 0.5061 | 0.7114 |
| No log | 52.0 | 52 | 0.5182 | 0.6115 | 0.5182 | 0.7199 |
| No log | 53.0 | 53 | 0.6300 | 0.5749 | 0.6300 | 0.7938 |
| No log | 54.0 | 54 | 0.6587 | 0.5621 | 0.6587 | 0.8116 |
| No log | 55.0 | 55 | 0.5826 | 0.5825 | 0.5826 | 0.7633 |
| No log | 56.0 | 56 | 0.5188 | 0.6153 | 0.5188 | 0.7202 |
| No log | 57.0 | 57 | 0.5322 | 0.5990 | 0.5322 | 0.7296 |
| No log | 58.0 | 58 | 0.5222 | 0.6063 | 0.5222 | 0.7226 |
| No log | 59.0 | 59 | 0.5422 | 0.6039 | 0.5422 | 0.7363 |
| No log | 60.0 | 60 | 0.5623 | 0.6149 | 0.5623 | 0.7499 |
| No log | 61.0 | 61 | 0.5325 | 0.6111 | 0.5325 | 0.7297 |
| No log | 62.0 | 62 | 0.5183 | 0.6155 | 0.5183 | 0.7199 |
| No log | 63.0 | 63 | 0.5249 | 0.6147 | 0.5249 | 0.7245 |
| No log | 64.0 | 64 | 0.5671 | 0.6099 | 0.5671 | 0.7531 |
| No log | 65.0 | 65 | 0.5586 | 0.6283 | 0.5586 | 0.7474 |
| No log | 66.0 | 66 | 0.5187 | 0.6227 | 0.5187 | 0.7202 |
| No log | 67.0 | 67 | 0.5186 | 0.6282 | 0.5186 | 0.7202 |
| No log | 68.0 | 68 | 0.5451 | 0.6341 | 0.5451 | 0.7383 |
| No log | 69.0 | 69 | 0.6355 | 0.6058 | 0.6355 | 0.7972 |
| No log | 70.0 | 70 | 0.6719 | 0.5993 | 0.6719 | 0.8197 |
| No log | 71.0 | 71 | 0.6346 | 0.6113 | 0.6346 | 0.7966 |
| No log | 72.0 | 72 | 0.5626 | 0.6297 | 0.5626 | 0.7501 |
| No log | 73.0 | 73 | 0.5456 | 0.6267 | 0.5456 | 0.7386 |
| No log | 74.0 | 74 | 0.5558 | 0.6280 | 0.5558 | 0.7455 |
| No log | 75.0 | 75 | 0.5926 | 0.6207 | 0.5926 | 0.7698 |
| No log | 76.0 | 76 | 0.6583 | 0.6000 | 0.6583 | 0.8114 |
| No log | 77.0 | 77 | 0.6705 | 0.5953 | 0.6705 | 0.8188 |
| No log | 78.0 | 78 | 0.6318 | 0.5952 | 0.6318 | 0.7949 |
| No log | 79.0 | 79 | 0.5808 | 0.6004 | 0.5808 | 0.7621 |
| No log | 80.0 | 80 | 0.5712 | 0.6150 | 0.5712 | 0.7558 |
| No log | 81.0 | 81 | 0.5841 | 0.6024 | 0.5841 | 0.7642 |
| No log | 82.0 | 82 | 0.6192 | 0.5995 | 0.6192 | 0.7869 |
| No log | 83.0 | 83 | 0.6872 | 0.5928 | 0.6872 | 0.8290 |
| No log | 84.0 | 84 | 0.7164 | 0.5895 | 0.7164 | 0.8464 |
| No log | 85.0 | 85 | 0.7038 | 0.5934 | 0.7038 | 0.8389 |
| No log | 86.0 | 86 | 0.6599 | 0.5914 | 0.6599 | 0.8123 |
| No log | 87.0 | 87 | 0.6061 | 0.6134 | 0.6061 | 0.7785 |
| No log | 88.0 | 88 | 0.5757 | 0.6273 | 0.5757 | 0.7588 |
| No log | 89.0 | 89 | 0.5674 | 0.6386 | 0.5674 | 0.7532 |
| No log | 90.0 | 90 | 0.5706 | 0.6379 | 0.5706 | 0.7554 |
| No log | 91.0 | 91 | 0.5840 | 0.6264 | 0.5840 | 0.7642 |
| No log | 92.0 | 92 | 0.6093 | 0.6242 | 0.6093 | 0.7806 |
| No log | 93.0 | 93 | 0.6366 | 0.6246 | 0.6366 | 0.7979 |
| No log | 94.0 | 94 | 0.6500 | 0.6186 | 0.6500 | 0.8063 |
| No log | 95.0 | 95 | 0.6512 | 0.6186 | 0.6512 | 0.8070 |
| No log | 96.0 | 96 | 0.6443 | 0.6217 | 0.6443 | 0.8027 |
| No log | 97.0 | 97 | 0.6329 | 0.6196 | 0.6329 | 0.7955 |
| No log | 98.0 | 98 | 0.6215 | 0.6188 | 0.6215 | 0.7884 |
| No log | 99.0 | 99 | 0.6151 | 0.6207 | 0.6151 | 0.7843 |
| No log | 100.0 | 100 | 0.6121 | 0.6148 | 0.6121 | 0.7824 |