Downloads · 30 days
49
2% of all-time downloads
KBioXLM
ngwlh/KBioXLM
KBioXLM is a fill-mask model from ngwlh. Use it when you need the model to fill a missing word. It is set up for transformers. The card lists the license as apache-2.0.
The aligned corpus constructed using the knowledge-anchored method is combined with a multi task training strategy to continue training XLM-R, thus obtaining KBioXLM. It is the first multilingual biomedical pre-traine…
All-time downloads
2.6K
Public
Repo size
2.9 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.bin1.1 GB · 98%
At a glance
- Task
- Fill-Mask
- Library
- transformers
- License
- apache-2.0
- Model type
- xlm-roberta
- Access
- Public
- Created
- Nov 20, 2023
- Updated
- Nov 21, 2023
- SHA
- cb86ce1e
Model card
From the Hugging Face model README
KBioXLM
The aligned corpus constructed using the knowledge-anchored method is combined with a multi task training strategy to continue training XLM-R, thus obtaining KBioXLM. It is the first multilingual biomedical pre-trained language model we know that has cross-lingual understanding capabilities in medical domain. It was introduced in the paper KBioXLM: A Knowledge-anchored Biomedical Multilingual Pretrained Language Model and released in this repository.
Model description
KBioXLM model can be fintuned on downstream tasks. The downstream tasks here refer to biomedical cross-lingual understanding tasks, such as biomedical entity recognition, biomedical relationship extraction and biomedical text classification.
Usage
You can follow the prompts below to load our model parameters:
from transformers import RobertaModel
model=RobertaModel.from_pretrained('ngwlh/KBioXLM')
BibTeX entry and citation info
Coming soon.
- Task
- Fill-Mask
- Library
- transformers
- Type
- xlm-roberta
- License
- apache-2.0
- Languages
- multilingual, en, zh
- Created
- Nov 20, 2023
- Updated
- Nov 21, 2023