Downloads · 30 days
33
5% of all-time downloads
bert-base-spanish-wwm-cased-ehealth_kd
IIC/bert-base-spanish-wwm-cased-ehealth_kd
bert-base-spanish-wwm-cased-ehealth_kd is a token classification model from IIC. Use it when you need labels on individual words, such as names. It is set up for transformers. The card lists the license as cc-by-4.0.
This model is a finetuned version of bert-base-spanish-wwm-cased for the eHealth-KD dataset used in a benchmark in the paper A comparative analysis of Spanish Clinical encoder-based models on NER and classification ta…
All-time downloads
653
Public
Parameters
110M
879 MB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin439 MB · 50%
Parameter types
How the weights are stored.
F32110M · 100%
Try a prompt
Datasets
Model card
From the Hugging Face model README
bert-base-spanish-wwm-cased-ehealth_kd
This model is a finetuned version of bert-base-spanish-wwm-cased for the eHealth-KD dataset used in a benchmark in the paper A comparative analysis of Spanish Clinical encoder-based models on NER and classification tasks. The model has a F1 of 0.843
Please refer to the original publication for more information.
Parameters used
| parameter | Value |
|---|---|
| batch size | 64 |
| learning rate | 4e-05 |
| classifier dropout | 0.2 |
| warmup ratio | 0 |
| warmup steps | 0 |
| weight decay | 0 |
| optimizer | AdamW |
| epochs | 10 |
| early stopping patience | 3 |
BibTeX entry and citation info
@article{10.1093/jamia/ocae054,
author = {García Subies, Guillem and Barbero Jiménez, Álvaro and Martínez Fernández, Paloma},
title = {A comparative analysis of Spanish Clinical encoder-based models on NER and classification tasks},
journal = {Journal of the American Medical Informatics Association},
volume = {31},
number = {9},
pages = {2137-2146},
year = {2024},
month = {03},
issn = {1527-974X},
doi = {10.1093/jamia/ocae054},
url = {https://doi.org/10.1093/jamia/ocae054},
}
- Task
- Token Classification
- Library
- transformers
- Type
- bert
- License
- cc-by-4.0
- Languages
- es
- Created
- Jun 21, 2023
- Updated
- Nov 25, 2024