Downloads · 30 days
2
4% of all-time downloads
AlaGrine/distilbert-base-uncased-finetuned-imdb-whole-word-masking
distilbert-base-uncased-finetuned-imdb-whole-word-masking is a fill-mask model from AlaGrine. Use it when you need the model to fill a missing word. It is set up for transformers. The card lists the license as apache-2.0.
This model is a fine-tuned version of distilbert-base-uncased on the IMDB dataset. It achieves the following results on the evaluation set: - Loss: 3.0554
Downloads · 30 days
2
4% of all-time downloads
All-time downloads
47
Public
Parameters
67M
1.6 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors268 MB · 100%
From the Hugging Face model README
This model is a fine-tuned version of distilbert-base-uncased on the IMDB dataset. It achieves the following results on the evaluation set:
The model is trained using whole word masking.
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss |
|---|---|---|---|
| 3.2819 | 1.0 | 782 | 3.1161 |
| 3.2058 | 2.0 | 1564 | 3.0585 |
| 3.1674 | 3.0 | 2346 | 3.0554 |