Downloads · 30 days
72
1% of all-time downloads
german_toxicity_classifier_plus_v2
EIStakovskii/german_toxicity_classifier_plus_v2
german_toxicity_classifier_plus_v2 is a text classification model from EIStakovskii. Use it when you need a label for a piece of text. It is set up for transformers. The card lists the license as other.
NB: this version of the model is the improved version of EIStakovskii/germantoxicityclassifierplus. To see the source code of training and the data please follow the github link.
All-time downloads
11.9K
Public
Parameters
110M
880 MB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.bin440 MB · 50%
Parameter types
How the weights are stored.
F32110M · 100%
Try a prompt
Model card
From the Hugging Face model README
Description
NB: this version of the model is the improved version of EIStakovskii/german_toxicity_classifier_plus. To see the source code of training and the data please follow the github link.
This model was trained for toxicity labeling.
The model was fine-tuned based off the dbmdz/bert-base-german-cased model.
To use the model:
from transformers import pipeline
classifier = pipeline("text-classification", model = 'EIStakovskii/german_toxicity_classifier_plus_v2')
print(classifier("Verpiss dich von hier"))
Metrics (at validation):
| epoch | step | eval_accuracy | eval_f1 | eval_loss |
|---|---|---|---|---|
| 0.8 | 1200 | 0.9132176234979973 | 0.9113535629048755 | 0.24135465919971466 |
Comparison against Perspective
This model was compared against the Google's Perspective API that similarly detects toxicity. Two models were tested on two datasets: the size of 200 sentences and 400 sentences. The first one (arguably harder) was collected from the sentences of the JigSaw and DeTox datasets. The second one (easier) was collected from the combination of sources: both from JigSaw and DeTox as well as Paradetox translations and sentences extracted from Reverso Context by keywords.
german_toxicity_classifier_plus_v2
| size | accuracy | f1 |
|---|---|---|
| 200 | 0.767 | 0.787 |
| 400 | 0.9650 | 0.9651 |
Perspective
| size | accuracy | f1 |
|---|---|---|
| 200 | 0.834 | 0.820 |
| 400 | 0.892 | 0.885 |
- Task
- Text Classification
- Library
- transformers
- Type
- bert
- License
- other
- Languages
- de
- Created
- Dec 2, 2022
- Updated
- Sep 4, 2023