Downloads · 30 days
20
2% of all-time downloads
biomedical-longformer-large
kiddothe2b/biomedical-longformer-large
biomedical-longformer-large is a fill-mask model from kiddothe2b. Use it when you need the model to fill a missing word. It is set up for transformers. The card lists the license as cc-by-nc-sa-4.0.
This is a derivative model based on microsoft/BiomedNLP-PubMedBERT-large-uncased-abstract BERT model developed in the work "Fine-Tuning Large Neural Language Models for Biomedical Natural Language Processing" by Tinn…
All-time downloads
1.3K
Public
Repo size
3.3 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin1.7 GB · 100%
At a glance
- Task
- Fill-Mask
- Library
- transformers
- License
- cc-by-nc-sa-4.0
- Model type
- longformer
- Access
- Public
- Created
- Feb 24, 2023
- Updated
- Feb 24, 2023
- SHA
- a62aaaac
Try a prompt
Model card
From the Hugging Face model README
Biomedical Longformer (base)
This is a derivative model based on microsoft/BiomedNLP-PubMedBERT-large-uncased-abstract BERT model developed in the work "Fine-Tuning Large Neural Language Models for Biomedical Natural Language Processing" by Tinn et al. (2021). All model parameters where cloned from the original model, while the positional embeddings were extended by cloning the original embeddings multiple times following Beltagy et al. (2020) using a python script similar to this one (https://github.com/allenai/longformer/blob/master/scripts/convert_model_to_long.ipynb).
- Task
- Fill-Mask
- Library
- transformers
- Type
- longformer
- License
- cc-by-nc-sa-4.0
- Languages
- en
- Created
- Feb 24, 2023
- Updated
- Feb 24, 2023