spam-detection-xlm-roberta-v2

Spam Detection for Social Media Text

Multilingual Indonesian & English | XLM-RoBERTa

This model is a fine-tuned XLM-RoBERTa designed to detect Spam vs Ham content in social media text.
It supports Indonesian and English Languages, making it suitable for multi-platform moderation use cases such as Twitter/X, Instagram, TikTok, Facebook, and online forums.

---

✨ Key Features

• ✅ Spam vs Ham classification
• 🌏 Multilingual support (Indonesian & English)
• 🧠 Based on XLM-RoBERTa (multilingual transformer)
• ⚡ Ready-to-use with Hugging Face pipeline
• 📊 Strong performance on noisy social media text

---

🌍 Supported Languages

• 🇮🇩 Bahasa Indonesia
• 🇬🇧 English

---

🧪 Model Performance

Evaluated on held-out validation data with balanced spam/ham distribution.

---

🚀 Quick Start

Installation

pip install transformers torch

Single Prediction

from transformers import pipeline

classifier = pipeline(
    task="text-classification",
    model="nahiar/spam-detection-xlm-roberta-v2"
)

result = classifier("PASTI DIJAMIN WDP 100%")
print(result)

Output

[{'label': 'LABEL_1', 'score': 0.9876}]

Label Mapping

LABEL_0 → HAM
LABEL_1 → SPAM

---

📦 Batch Inference Example

"texts": [
        "साइबर हमले के बाद JLR का बड़ा बयान - जानें कंपनी ने क्या कहा | Tata Motors के शेयर पर दिखेगा असर?

#TataMotors #JLR #CyberAttack 

https://t.co/6WlGS77UUp",
        "Kita sudah Ready skrg ini bagi yang memerlukan jasa pemulihan akun & Hapus All akun 

 Lacak lokasi / sadap wa / Hack Akun / Revengeporn - korban pemerasan vcs / terror

TIKTOK,GMAIL,TWITER,TELEGRAM,
FACEBOOK,INSTAGRAM 
#revengeporn #zonauangᅠᅠᅠ 
 ☎️ https://t.co/K0AbW08qnU https://t.co/4IpWNA7a0z",
        "💥Slot Gacor Hari ini Rute303
💥Jaminan Jackpot Maxwin malam ini

LINK SLOT GACOR HARI INI : https://t.co/QvxjCAnt8o

Tags:
Jumbo #timsekop Jumat gratis ongkir Like Crazy PSIM https://t.co/ukuRdlvgGA"
    ]

results = classifier(texts)

for text, result in zip(texts, results):
    print(f"{text} -> {result['label']} ({result['score']:.4f})")

---

🏗️ Training Configuration

---

🎯 Intended Use Cases

• Social media spam moderation
• Comment & post filtering
• Content quality control
• Pre-filtering for sentiment or topic analysis pipelines

---

⚠️ Limitations

• Binary classification only (Spam / Ham)
• Not optimized for non-social-media formal text
• Performance may degrade on very short or ambiguous messages
• The model still has the potential to be biased

---

📜 License

Released under the Apache 2.0 License. Free for commercial and research use.

---

📚 Citation

If you use this model in your work, please cite:

@misc{djunaedi2026spam,
  author    = {AI/ML Engineer ADS Digital Partner},
  title     = {Spam Detection for Social Media Text},
  year      = {2025},
  publisher = {Hugging Face},
  url       = {https://huggingface.co/nahiar/spam-detection-xlm-roberta-v2}
}

---

🙌 Acknowledgements

• Hugging Face Transformers
• Facebook AI Research — XLM-RoBERTa