Downloads · 30 days
1.6K
0% of all-time downloads
roberta-spam
mshenoda/roberta-spam
roberta-spam is a text classification model from mshenoda. Use it when you need a label for a piece of text. It is set up for transformers. The card lists the license as mit.
Spam messages frequently carry malicious links or phishing attempts posing significant threats to both organizations and their users. By choosing our RoBERTa-based spam message detection system, organizations can grea…
All-time downloads
1.1M
Public
Parameters
125M
997 MB on disk
Likes
33
Public
Repo makeup
Click a slice to open those files.
.bin499 MB · 50%
Parameter types
How the weights are stored.
F32125M · 100%
Try a prompt
Datasets
Model card
From the Hugging Face model README
RoBERTa based Spam Message Detection
Spam messages frequently carry malicious links or phishing attempts posing significant threats to both organizations and their users. By choosing our RoBERTa-based spam message detection system, organizations can greatly enhance their security infrastructure. Our system effectively detects and filters out spam messages, adding an extra layer of security that safeguards organizations against potential financial losses, legal consequences, and reputational harm.
Found this model useful:
Your feedback is important and would help keep this relevent.
Metrics
| Loss | Accuracy(99.06%) | Precision(99.71%) / Recall(99.34%) | Confusion Matrix |
|---|---|---|---|
 Train / Validation |  Validation |  Validation |  Testing Set |
Model Output
- 0 is ham
- 1 is spam
Dataset
https://huggingface.co/datasets/mshenoda/spam-messages
The dataset is composed of messages labeled by ham or spam, merged from three data sources:
- SMS Spam Collection https://www.kaggle.com/datasets/uciml/sms-spam-collection-dataset
- Telegram Spam Ham https://huggingface.co/datasets/thehamkercat/telegram-spam-ham/tree/main
- Enron Spam: https://huggingface.co/datasets/SetFit/enron_spam/tree/main (only used message column and labels)
The prepare script for enron is available at https://github.com/mshenoda/roberta-spam/tree/main/data/enron. The data is split 80% train 10% validation, and 10% test sets; the scripts used to split and merge of the three data sources are available at: https://github.com/mshenoda/roberta-spam/tree/main/data/utils.
Dataset Class Distribution
| Training 80% | Validation 10% | Testing 10% |
|---|---|---|
 Class Distribution |  Class Distribution |  Class Distribution |
Architecture
The model is fine tuned RoBERTa
roberta-base: https://huggingface.co/roberta-base
paper: https://arxiv.org/abs/1907.11692
Code
- Task
- Text Classification
- Library
- transformers
- Type
- roberta
- License
- mit
- Languages
- en
- Created
- Jun 4, 2023
- Updated
- Aug 24, 2025