Downloads · 30 days
12
21% of all-time downloads
clinical-sts-NeuML-pubmedbert-base-embeddings
youssefkhalil320/clinical-sts-NeuML-pubmedbert-base-embeddings
clinical-sts-NeuML-pubmedbert-base-embeddings is a machine learning model from youssefkhalil320. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Fine-tuned from NeuML/pubmedbert-base-embeddings on a clinical text-pair similarity dataset.
All-time downloads
57
Public
Parameters
109M
438 MB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors438 MB · 100%
At a glance
- Model type
- bert
- Access
- Public
- Created
- Apr 12, 2026
- Updated
- Apr 12, 2026
- SHA
- 054173dc
Base models
Model card
From the Hugging Face model README
Clinical STS Regression Model
Fine-tuned from NeuML/pubmedbert-base-embeddings on a clinical text-pair similarity dataset.
Training config
{
"train": "./med_sts/clinicalSTS.train.txt",
"test": "./med_sts/clinicalSTS.test.txt",
"model": [
"NeuML/pubmedbert-base-embeddings"
],
"epochs": 20,
"batch_size": 16,
"lr": 2e-05,
"weight_decay": 0.01,
"warmup_ratio": 0.1,
"max_grad_norm": 1.0,
"dropout": 0.1,
"max_len": 256,
"seed": 42,
"patience": 5,
"output_dir": "./sts_val/clinical-sts-NeuML-pubmedbert-base-embeddings",
"wandb_project": "clinical-sts",
"hf_repo": "youssefkhalil320/clinical-sts-NeuML-pubmedbert-base-embeddings"
}
Best test Spearman ρ: 0.7766
- Type
- bert
- Languages
- en
- Created
- Apr 12, 2026
- Updated
- Apr 12, 2026