Downloads · 30 days
13
3% of all-time downloads
roberta-large-bne-ctebmsp
IIC/roberta-large-bne-ctebmsp
roberta-large-bne-ctebmsp is a token classification model from IIC. Use it when you need labels on individual words, such as names. It is set up for transformers. The card lists the license as apache-2.0.
This model is a finetuned version of roberta-large-bne for the CT-EBM-SP (Clinical Trials for Evidence-based Medicine in Spanish) dataset used in a benchmark in the paper A comparative analysis of Spanish Clinical enc…
All-time downloads
489
Public
Parameters
355M
2.8 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin1.4 GB · 50%
Parameter types
How the weights are stored.
F32355M · 100%
Try a prompt
Datasets
Model card
From the Hugging Face model README
roberta-large-bne-ctebmsp
This model is a finetuned version of roberta-large-bne for the CT-EBM-SP (Clinical Trials for Evidence-based Medicine in Spanish) dataset used in a benchmark in the paper A comparative analysis of Spanish Clinical encoder-based models on NER and classification tasks. The model has a F1 of 0.877
Please refer to the original publication for more information.
Parameters used
| parameter | Value |
|---|---|
| batch size | 64 |
| learning rate | 2e-05 |
| classifier dropout | 0.1 |
| warmup ratio | 0 |
| warmup steps | 0 |
| weight decay | 0 |
| optimizer | AdamW |
| epochs | 10 |
| early stopping patience | 3 |
BibTeX entry and citation info
@article{10.1093/jamia/ocae054,
author = {García Subies, Guillem and Barbero Jiménez, Álvaro and Martínez Fernández, Paloma},
title = {A comparative analysis of Spanish Clinical encoder-based models on NER and classification tasks},
journal = {Journal of the American Medical Informatics Association},
volume = {31},
number = {9},
pages = {2137-2146},
year = {2024},
month = {03},
issn = {1527-974X},
doi = {10.1093/jamia/ocae054},
url = {https://doi.org/10.1093/jamia/ocae054},
}
- Task
- Token Classification
- Library
- transformers
- Type
- roberta
- License
- apache-2.0
- Languages
- es
- Created
- Jun 21, 2023
- Updated
- Jan 17, 2025