Downloads · 30 days
119
0% of all-time downloads
IbrahimAmin/marbertv2-finetuned-egyptian-hate-speech-detection
marbertv2-finetuned-egyptian-hate-speech-detection is a text classification model from IbrahimAmin. Use it when you need a label for a piece of text. It is set up for transformers. The card lists the license as apache-2.0.
Author: IbrahimAmin, Mostafa Abbas, Rany Hatem, Andrew Ihab, Mohamed Waleed Fahkr \ License: Apache-2.0 \ Paper: Fine-tuning Arabic Pre-Trained Transformer Models for Egyptian-Arabic Dialect Offensive Language and Hat…
Downloads · 30 days
119
0% of all-time downloads
All-time downloads
36.5K
Public
Parameters
163M
1.3 GB on disk
Likes
3
Public
Click a slice to open those files.
.bin651 MB · 50%
How the weights are stored.
F32163M · 100%
From the Hugging Face model README
Author: IbrahimAmin, Mostafa Abbas, Rany Hatem, Andrew Ihab, Mohamed Waleed Fahkr
License: Apache-2.0
Paper: Fine-tuning Arabic Pre-Trained Transformer Models for Egyptian-Arabic Dialect Offensive Language and Hate Speech Detection and Classification
Languages: Arabic (Egyptian Dialect)
This model is a fine-tuned version of MARBERTv2. We finetuned this model for binary text classification (Neutral-Hate)
on a sampled version of a custom Egyptian-Arabic hate speech dataset.
import torch
from transformers import pipeline, AutoTokenizer, AutoModelForSequenceClassification
device = "cuda:0" if torch.cuda.is_available() else "cpu"
model = AutoModelForSequenceClassification.from_pretrained("IbrahimAmin/marbertv2-finetuned-egyptian-hate-speech-detection")
tokenizer = AutoTokenizer.from_pretrained("IbrahimAmin/marbertv2-finetuned-egyptian-hate-speech-detection")
classifier = pipeline("text-classification", model=model, tokenizer=tokenizer, device=device)
result = classifier("مبحبش الخلايجه")
print(result)
This model is intended for research and content moderation purposes and is not meant to offend, harm, or promote discrimination against any individual or group. It is important to use this model responsibly and consider the context in which it is applied. Any offensive content detected by the model should be treated with caution and handled appropriately.
Model fine-tuning, data collection, annotation and pre-processing for this work were performed as part of a Graduation Project from the Faculty of Engineering, AASTMT, Computer Engineering Program.
If you use this model in your work, please cite:
@INPROCEEDINGS{10009167,
author={Ahmed, Ibrahim and Abbas, Mostafa and Hatem, Rany and Ihab, Andrew and Fahkr, Mohamed Waleed},
booktitle={2022 20th International Conference on Language Engineering (ESOLEC)},
title={Fine-tuning Arabic Pre-Trained Transformer Models for Egyptian-Arabic Dialect Offensive Language and Hate Speech Detection and Classification},
year={2022},
volume={20},
number={},
pages={170-174},
keywords={Social networking (online);Text categorization;Hate speech;Blogs;Transformers;Natural language processing;Task analysis;Arabic Hate Speech;Natural Language Processing;Transformers;Text Classification},
doi={10.1109/ESOLEC54569.2022.10009167}}