Downloads · 30 days
13
1% of all-time downloads
efficient_mlm_m0.40
princeton-nlp/efficient_mlm_m0.40
efficient_mlm_m0.40 is a fill-mask model from princeton-nlp. Use it when you need the model to fill a missing word. It is set up for transformers.
This is a model checkpoint for "Should You Mask 15% in Masked Language Modeling" (code). We use pre layer norm, which is not supported by HuggingFace. To use our model, go to our github repo, download our code, and im…
All-time downloads
1.1K
Public
Repo size
2.8 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin1.4 GB · 100%
At a glance
- Task
- Fill-Mask
- Library
- transformers
- Model type
- roberta
- Access
- Public
- Created
- Apr 22, 2022
- Updated
- Apr 27, 2022
- SHA
- 08e44702
Try a prompt
Model card
From the Hugging Face model README
This is a model checkpoint for "Should You Mask 15% in Masked Language Modeling" (code). We use pre layer norm, which is not supported by HuggingFace. To use our model, go to our github repo, download our code, and import the RoBERTa class from huggingface/modeling_roberta_prelayernorm.py. For example,
from huggingface.modeling_roberta_prelayernorm import RobertaForMaskedLM, RobertaForSequenceClassification
- Task
- Fill-Mask
- Library
- transformers
- Type
- roberta
- Created
- Apr 22, 2022
- Updated
- Apr 27, 2022