Downloads · 30 days
10
1% of all-time downloads
remote-sensing-distilbert-cased
marcellopoliti/remote-sensing-distilbert-cased
remote-sensing-distilbert-cased is a fill-mask model from marcellopoliti. Use it when you need the model to fill a missing word. It is set up for transformers.
All-time downloads
805
Public
Repo size
527 MB
Likes
3
Public
Repo makeup
Click a slice to open those files.
.bin263 MB · 100%
At a glance
- Task
- Fill-Mask
- Library
- transformers
- Model type
- distilbert
- Access
- Public
- Created
- May 9, 2022
- Updated
- May 10, 2022
- SHA
- 1cd7f7c7
Try a prompt
Model card
From the Hugging Face model README
RemoteSensing Distilbert
The field of earth observation is increasingly growing. More and more data scientists are interested about this domain, and they're developing computer vision applications that do amazing things, while NLP doesn't seem to be given much consideration in this area That's why I posted Chramer/remote-sensing-distilbert-cased. This is masked language model trained on a corpus of technical information about space missions, instruments, and sensors.
The model is based on distilbert-base-cased, but I didn't have the chance to play with the hyperparameters of the model because of the limited computational capabilities I have. So there's a lot to improve! 😆
It was fun to publish my first model on hugging face! 🤩
Author: Marcello Politi (Twitter 🐦 ,LinkedIn 💼).
Perplexity
Test set: 4.5k sentences about technical space stuff.
| Model | Perplexity |
|---|---|
| remote-sensing-distilbert-cased | 6.45 |
| distilbert-base-cased | 33.77 |
Usage
from transformers import AutoModel, AutoTokenizer
model_name = "Chramer/remote-sensing-distilbert-cased"
tokenizer = AutoTokenizer.from_pretrained(model_name)
model = AutoModel.from_pretrained(model_name)
- Task
- Fill-Mask
- Library
- transformers
- Type
- distilbert
- Created
- May 9, 2022
- Updated
- May 10, 2022