mbert_gru_bot

IndoBERT-GRU for Bot Detection on Platform X

This model uses BERT-BASE-MULTILINGUAL-CASED to classify Twitter/X accounts as bots or humans based on textual content and numeric features.

Model Architecture

• Base Model: bert-base-multilingual-cased
• Classifier: GRU + 2-layer Feedforward (ReLU + Sigmoid)

Dataset

This dataset consists of Indonesian tweets with labels (0 for human, 1 for bot), combined with numeric features like favorite_count, retweet_count, reply_count, and quote_count.

Training Details

• Loss Function: Binary Cross Entropy (BCELoss)
• Optimizer: Adam (lr = 2e-5)
• Epochs: 10
• Max Token Length: 128
• Batch Size: 16

Training Log

Evaluation Results

Final Validation Accuracy: 0.5620 Final Precision: 0.5338 Final Recall: 1.0000 Final F1-score: 0.6960

Final ROC AUC: 0.9750

Confusion Matrix

ROC Curve

Classification Report

              precision    recall  f1-score   support

       Human       0.90      0.91      0.91      1994
         Bot       0.91      0.90      0.91      2006

    accuracy                           0.91      4000
   macro avg       0.91      0.91      0.91      4000
weighted avg       0.91      0.91      0.91      4000