egyptian-text-classification

Egyptian Dialect Text Classification by Fine-tuning AraBERT 🇪🇬

This model is a fine-tuned version of aubmindlab/bert-base-arabertv2, specifically trained on Egyptian Arabic text for hate speech and offensive language classification

with 92% accurency.

It classifies text into 6 categories :

---

Training Details

• Base Model: AraBERT v2 (aubmindlab/bert-base-arabertv2)
• Dataset: Egyptian Arabic hate speech dataset with 6 labeled categories
• Epochs: Trained for 30 epochs with early stopping after 5 epochs without improvement
• Optimizer Enhancements: Used label smoothing with a factor of 0.1 for better generalization
• Best Model Selection: Based on weighted average F1-score

---

Performance Metrics

Training was done using a GPU (cuda). Below is a snapshot of model performance across the first 15 epochs:

---

Using the Model Without a Token (For End Users)

Since the model Woolv7007/egyptian-text-classification and the labels.json file are publicly available, you can load the model, tokenizer, and labels directly without needing any Hugging Face token or special setup.

How to automatically load and use the model with labels:

• Download the labels.json file directly from Hugging Face Hub.
• Load the model and tokenizer without a token.
• Perform prediction on your texts and map the predicted class index to its label from the labels list.
• Or you can call the labels.json file address with this code

labels_url = f"https://huggingface.co/{model_name}/resolve/main/labels.json"
labels = requests.get(labels_url).json()

---

Example Python Code:

import requests
import torch
from transformers import AutoTokenizer, AutoModelForSequenceClassification

# Model name on Hugging Face Hub
model_name = "Woolv7007/egyptian-text-classification"

# Load labels.json from the public repository without a token
labels_url = f"https://huggingface.co/{model_name}/resolve/main/labels.json"
labels = requests.get(labels_url).json()

# Load model and tokenizer without a token
tokenizer = AutoTokenizer.from_pretrained(model_name)
model = AutoModelForSequenceClassification.from_pretrained(model_name)
model.eval()

# Simple prediction function that returns the predicted label
def predict(text):
    inputs = tokenizer(text, return_tensors="pt", truncation=True, padding=True, max_length=256)
    with torch.no_grad():
        outputs = model(**inputs)
        pred_id = torch.argmax(outputs.logits, dim=1).item()
    return labels[pred_id]

# Verbose prediction with probability scores for each label (optional)
def predict_verbose(text):
    inputs = tokenizer(text, return_tensors="pt", truncation=True, padding=True, max_length=256)
    with torch.no_grad():
        logits = model(**inputs).logits
        probs = torch.softmax(logits, dim=1).squeeze().tolist()
    for label, prob in zip(labels, probs):
        print(f"{label}: {prob:.2%}")
    return labels[torch.argmax(logits).item()]

# Example usage
text = "طز في اي حد مش عاجبه شغلي"
print("Text:", text)
print("Predicted label:", predict(text))

# To see detailed output with probabilities, uncomment:
#print("Prediction with probabilities:")
#predict_verbose(text)