German-MedBERT

smanjil/German-MedBERT

German-MedBERT is a fill-mask model from smanjil. Use it when you need the model to fill a missing word. It is set up for transformers.

<a href="https://huggingface.co/exbert/?model=smanjil/German-MedBERT" <img width="300px" src="https://cdn-media.huggingface.co/exbert/button.png" </a

Downloads · 30 days

227

0% of all-time downloads

All-time downloads

1.7M

Public

Repo size

1.8 GB

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.h5530 MB · 38%

At a glance

Task: Fill-Mask
Library: transformers
Model type: bert
Access: Public
Created: Mar 2, 2022
Updated: Jun 13, 2022
SHA: b4e8a3e2

Spaces

Tej3/ECG_Classification

Model card

From the Hugging Face model README

German Medical BERT

This is a fine-tuned model on the Medical domain for the German language and based on German BERT. This model has only been trained to improve on-target tasks (Masked Language Model). It can later be used to perform a downstream task of your needs, while I performed it for the NTS-ICD-10 text classification task.

Overview

Language model: bert-base-german-cased

Language: German

Fine-tuning: Medical articles (diseases, symptoms, therapies, etc..)

Eval data: NTS-ICD-10 dataset (Classification)

Infrastructure: Google Colab

Details

We fine-tuned using Pytorch with Huggingface library on Colab GPU.
With standard parameter settings for fine-tuning as mentioned in the original BERT paper.
Although had to train for up to 25 epochs for classification.

Performance (Micro precision, recall, and f1 score for multilabel code classification)

Models	P	R	F1
German BERT	86.04	75.82	80.60
German MedBERT-256 (fine-tuned)	87.41	77.97	82.42
German MedBERT-512 (fine-tuned)	87.75	78.26	82.73

Author

Manjil Shrestha: shresthamanjil21 [at] gmail.com