Downloads · 30 days
57
8% of all-time downloads
robingeibel/reformer-finetuned-big_patent-16384
reformer-finetuned-big_patent-16384 is a fill-mask model from robingeibel. Use it when you need the model to fill a missing word. It is set up for transformers.
should probably proofread and complete it, then remove this comment. --
Downloads · 30 days
57
8% of all-time downloads
All-time downloads
699
Public
Repo size
585 MB
Likes
0
Public
Click a slice to open those files.
.bin186 MB · 99%
From the Hugging Face model README
This model is a fine-tuned version of robingeibel/reformer-finetuned-big_patent-wikipedia-arxiv-16384 on the big_patent dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss |
|---|---|---|---|
| 6.7398 | 1.0 | 53286 | 6.7243 |
| 6.7449 | 2.0 | 106572 | 6.7388 |
| 6.7534 | 3.0 | 159858 | 6.7382 |