Downloads · 30 days
17
3% of all-time downloads
HERBERT-P
ICB-UMA/HERBERT-P
HERBERT-P is a feature extraction model from ICB-UMA. Use it when you need embeddings to search or compare text. It is set up for transformers. The card lists the license as mit.
HERBERT-P is a contrastive-learning-based bi-encoder for medical entity normalization in Spanish, leveraging synonym and parent relationships from UMLS to enhance candidate retrieval for entity linking in clinical texts.
All-time downloads
495
Public
Parameters
126M
504 MB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors504 MB · 99%
At a glance
- Task
- Feature Extraction
- Library
- transformers
- License
- mit
- Model type
- roberta
- Access
- Public
- Created
- Jun 20, 2025
- Updated
- Jun 20, 2025
- SHA
- a14333e6
Base models
Model card
From the Hugging Face model README
HERBERT: Leveraging UMLS Hierarchical Knowledge to Enhance Clinical Entity Normalization in Spanish
HERBERT-P is a contrastive-learning-based bi-encoder for medical entity normalization in Spanish, leveraging synonym and parent relationships from UMLS to enhance candidate retrieval for entity linking in clinical texts.
Key features:
- Base model: PlanTL-GOB-ES/roberta-base-biomedical-clinical-es
- Trained with 15 positive pairs per anchor (synonyms + parents)
- Task: Normalization of disease, procedure, and symptom mentions to SNOMED-CT/UMLS codes.
- Domain: Spanish biomedical/clinical texts.
- Corpora: DisTEMIST, MedProcNER, SympTEMIST.
Benchmark Results
| Corpus | Top-1 | Top-5 | Top-25 | Top-200 |
|---|---|---|---|---|
| DisTEMIST | 0.574 | 0.720 | 0.803 | 0.869 |
| SympTEMIST | 0.630 | 0.779 | 0.881 | 0.945 |
| MedProcNER | 0.651 | 0.763 | 0.838 | 0.892 |
- Task
- Feature Extraction
- Library
- transformers
- Type
- roberta
- License
- mit
- Languages
- es
- Created
- Jun 20, 2025
- Updated
- Jun 20, 2025