Downloads · 30 days
25
3% of all-time downloads
robingeibel/reformer-finetuned-big_patent-wikipedia-arxiv-16384
reformer-finetuned-big_patent-wikipedia-arxiv-16384 is a fill-mask model from robingeibel. Use it when you need the model to fill a missing word. It is set up for transformers.
should probably proofread and complete it, then remove this comment. --
Downloads · 30 days
25
3% of all-time downloads
All-time downloads
867
Public
Repo size
929 MB
Likes
0
Public
Click a slice to open those files.
.bin186 MB · 100%
From the Hugging Face model README
This model is a fine-tuned version of robingeibel/reformer-finetuned-big_patent-wikipedia-arxiv-16384 on the wikipedia dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss |
|---|---|---|---|
| 8.0368 | 1.0 | 3785 | 6.7392 |
| 6.7992 | 2.0 | 7570 | 6.5576 |
| 6.6926 | 3.0 | 11355 | 6.5256 |