Downloads · 30 days
3
1% of all-time downloads
hanyuany14/finetuned-DSCS24-mitre-distilbert-base-uncased-fill-mask
finetuned-DSCS24-mitre-distilbert-base-uncased-fill-mask is a fill-mask model from hanyuany14. Use it when you need the model to fill a missing word. It is set up for transformers. The card lists the license as apache-2.0.
should probably proofread and complete it, then remove this comment. --
Downloads · 30 days
3
1% of all-time downloads
All-time downloads
349
Public
Parameters
67M
8.3 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors268 MB · 100%
From the Hugging Face model README
This model is a fine-tuned version of distilbert-base-uncased on the None dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss |
|---|---|---|---|
| 2.7512 | 1.0 | 65 | 2.4057 |
| 2.3941 | 2.0 | 130 | 2.2818 |
| 2.2615 | 3.0 | 195 | 2.2630 |
| 2.2113 | 4.0 | 260 | 2.1359 |
| 2.1435 | 5.0 | 325 | 2.1022 |
| 2.0719 | 6.0 | 390 | 2.0463 |
| 2.0483 | 7.0 | 455 | 2.0830 |
| 2.0175 | 8.0 | 520 | 1.9946 |
| 1.9778 | 9.0 | 585 | 2.0038 |
| 1.9831 | 10.0 | 650 | 1.9502 |
| 1.8909 | 11.0 | 715 | 1.9914 |
| 1.9602 | 12.0 | 780 | 2.0588 |
| 1.9309 | 13.0 | 845 | 2.0038 |
| 1.9112 | 14.0 | 910 | 1.9957 |
| 1.9197 | 15.0 | 975 | 2.0338 |