Downloads · 30 days
32
7% of all-time downloads
XLM_R_Galen-cantemist
IIC/XLM_R_Galen-cantemist
XLM_R_Galen-cantemist is a text classification model from IIC. Use it when you need a label for a piece of text. It is set up for transformers. The card lists the license as mit.
This model is a finetuned version of XLMRGalen for the cantemist dataset used in a benchmark in the paper A comparative analysis of Spanish Clinical encoder-based models on NER and classification tasks. The model has…
All-time downloads
486
Public
Parameters
278M
2.2 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin1.1 GB · 50%
Parameter types
How the weights are stored.
F32278M · 100%
Try a prompt
Datasets
Model card
From the Hugging Face model README
XLM_R_Galen-cantemist
This model is a finetuned version of XLM_R_Galen for the cantemist dataset used in a benchmark in the paper A comparative analysis of Spanish Clinical encoder-based models on NER and classification tasks. The model has a F1 of 0.898
Please refer to the original publication for more information.
Parameters used
| parameter | Value |
|---|---|
| batch size | 16 |
| learning rate | 4e05 |
| classifier dropout | 0 |
| warmup ratio | 0 |
| warmup steps | 0 |
| weight decay | 0 |
| optimizer | AdamW |
| epochs | 10 |
| early stopping patience | 3 |
BibTeX entry and citation info
@article{10.1093/jamia/ocae054,
author = {García Subies, Guillem and Barbero Jiménez, Álvaro and Martínez Fernández, Paloma},
title = {A comparative analysis of Spanish Clinical encoder-based models on NER and classification tasks},
journal = {Journal of the American Medical Informatics Association},
volume = {31},
number = {9},
pages = {2137-2146},
year = {2024},
month = {03},
issn = {1527-974X},
doi = {10.1093/jamia/ocae054},
url = {https://doi.org/10.1093/jamia/ocae054},
}
- Task
- Text Classification
- Library
- transformers
- Type
- xlm-roberta
- License
- mit
- Languages
- es
- Created
- Jun 19, 2023
- Updated
- Nov 25, 2024