Downloads · 30 days
16
2% of all-time downloads
spacescibert
icelab/spacescibert
spacescibert is a fill-mask model from icelab. Use it when you need the model to fill a missing word. It is set up for transformers. The card lists the license as mit.
This is one of the 3 further pre-trained models from the SpaceTransformers family presented in SpaceTransformers: Language Modeling for Space Systems. The original Git repo is strath-ace/smart-nlp.
All-time downloads
1K
Public
Repo size
1.8 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.pt880 MB · 67%
At a glance
- Task
- Fill-Mask
- Library
- transformers
- License
- mit
- Model type
- bert
- Access
- Public
- Created
- Mar 2, 2022
- Updated
- Sep 29, 2022
- SHA
- 4b6d900b
Try a prompt
Model card
From the Hugging Face model README
SpaceSciBERT
This is one of the 3 further pre-trained models from the SpaceTransformers family presented in SpaceTransformers: Language Modeling for Space Systems. The original Git repo is strath-ace/smart-nlp.
The further pre-training corpus includes publications abstracts, books, and Wikipedia pages related to space systems. Corpus size is 14.3 GB. SpaceSciBERT was further pre-trained on this domain-specific corpus from SciBERT-SciVocab (uncased). In our paper, it is then fine-tuned for a Concept Recognition task.
BibTeX entry and citation info
@ARTICLE{
9548078,
author={Berquand, Audrey and Darm, Paul and Riccardi, Annalisa},
journal={IEEE Access},
title={SpaceTransformers: Language Modeling for Space Systems},
year={2021},
volume={9},
number={},
pages={133111-133122},
doi={10.1109/ACCESS.2021.3115659}
}
- Task
- Fill-Mask
- Library
- transformers
- Type
- bert
- License
- mit
- Languages
- en
- Created
- Mar 2, 2022
- Updated
- Sep 29, 2022