Downloads · 30 days
158
2% of all-time downloads
biomedical-longformer-base
kiddothe2b/biomedical-longformer-base
biomedical-longformer-base is a fill-mask model from kiddothe2b. Use it when you need the model to fill a missing word. It is set up for transformers. The card lists the license as cc-by-nc-sa-4.0.
This is a derivative model based on microsoft/BiomedNLP-PubMedBERT-base-uncased-abstract BERT model developed in the work "Fine-Tuning Large Neural Language Models for Biomedical Natural Language Processing" by Tinn e…
All-time downloads
6.6K
Public
Repo size
1.1 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin534 MB · 100%
At a glance
- Task
- Fill-Mask
- Library
- transformers
- License
- cc-by-nc-sa-4.0
- Model type
- longformer
- Access
- Public
- Created
- Feb 24, 2023
- Updated
- Feb 24, 2023
- SHA
- 12538599
Try a prompt
Model card
From the Hugging Face model README
Biomedical Longformer (base)
This is a derivative model based on microsoft/BiomedNLP-PubMedBERT-base-uncased-abstract BERT model developed in the work "Fine-Tuning Large Neural Language Models for Biomedical Natural Language Processing" by Tinn et al. (2021). All model parameters where cloned from the original model, while the positional embeddings were extended by cloning the original embeddings multiple times following Beltagy et al. (2020) using a python script similar to this one (https://github.com/allenai/longformer/blob/master/scripts/convert_model_to_long.ipynb).
- Task
- Fill-Mask
- Library
- transformers
- Type
- longformer
- License
- cc-by-nc-sa-4.0
- Languages
- en
- Created
- Feb 24, 2023
- Updated
- Feb 24, 2023