Downloads · 30 days
2
1% of all-time downloads
judy93536/RoBERTa-perigon-news
RoBERTa-perigon-news is a fill-mask model from judy93536. Use it when you need the model to fill a missing word. It is set up for transformers. The card lists the license as mit.
should probably proofread and complete it, then remove this comment. --
Downloads · 30 days
2
1% of all-time downloads
All-time downloads
153
Public
Repo size
21.5 GB
Likes
0
Public
Click a slice to open those files.
.bin499 MB · 99%
From the Hugging Face model README
This model is a fine-tuned version of roberta-base on an unknown dataset. It achieves the following results on the evaluation set:
The model was pre-trained for a MLM taskusing over 200K financial news articles obtaind from Perigon https://www.goperigon.com/.
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss |
|---|---|---|---|
| 1.4872 | 1.0 | 5480 | 1.3355 |
| 1.3571 | 2.0 | 10960 | 1.2488 |
| 1.3078 | 3.0 | 16440 | 1.2144 |
| 1.2425 | 4.0 | 21920 | 1.1634 |
| 1.2035 | 5.0 | 27400 | 1.1309 |
| 1.157 | 6.0 | 32880 | 1.0941 |
| 1.1268 | 7.0 | 38360 | 1.0696 |
| 1.098 | 8.0 | 43840 | 1.0466 |
| 1.0681 | 9.0 | 49320 | 1.0297 |
| 1.0356 | 10.0 | 54800 | 1.0168 |
| 1.0194 | 11.0 | 60280 | 1.0011 |
| 0.9941 | 12.0 | 65760 | 0.9843 |
| 0.981 | 13.0 | 71240 | 0.9716 |
| 0.9634 | 14.0 | 76720 | 0.9600 |
| 0.9511 | 15.0 | 82200 | 0.9546 |