Downloads · 30 days
22
5% of all-time downloads
BIOptimus
rttl-ai/BIOptimus
BIOptimus is a fill-mask model from rttl-ai. Use it when you need the model to fill a missing word. It is set up for transformers. The card lists the license as apache-2.0.
Model Description: BIOptimus v.0.4 model is a BERT-like model pre-trained on PubMed abstracts. It is a biomedical language model pre-trained using contextualized weight distillation and Curriculum Learning. This model…
All-time downloads
457
Public
Repo size
2.2 GB
Likes
2
Public
Repo makeup
Click a slice to open those files.
.pt876 MB · 67%
At a glance
- Task
- Fill-Mask
- Library
- transformers
- License
- apache-2.0
- Model type
- bert
- Access
- Public
- Created
- Jun 23, 2023
- Updated
- Jun 8, 2024
- SHA
- 22e0b56a
Try a prompt
Datasets
Model card
From the Hugging Face model README
rttl-ai/BIOptimus v.0.4
Model Details
Model Description: BIOptimus v.0.4 model is a BERT-like model pre-trained on PubMed abstracts. It is a biomedical language model pre-trained using contextualized weight distillation and Curriculum Learning. This model achieves state-of-the-art performance on several biomedical NER datasets from BLURB benchmark.
- Developed by: rttl-ai
- Model Type: Language model
- Language(s): English
- License: Apache-2.0
- Resources for more information:
- It is introduced in the paper BIOptimus: Pre-training an Optimal Biomedical Language Model with Curriculum Learning for Named Entity Recognition (BioNLP workshop @ ACL 2023).
- arxiv
- arxiv
- More information is available in this repository.
- Task
- Fill-Mask
- Library
- transformers
- Type
- bert
- License
- apache-2.0
- Languages
- en
- Created
- Jun 23, 2023
- Updated
- Jun 8, 2024