Trained-indobertweet-balanced-dataset

IndoBERTweet Multiclass with Balanced Augmented Dataset Model

Overview

This repository contains a trained IndoBERTweet model for text classification. The model has been trained and evaluated on a balanced dataset comprising various labels such as Politics, Social Culture, Defense and Security, Ideology, Economy, Natural Resources, Demography, and Geography.

Dataset Information

Before Augmentation/Balancing

After Balancing

Label Encoding

Data Split

• Train Size: 4326 samples (85%)
• Test Size: 764 samples (15%)

Model Training Log

Epoch 1/4

• Train Loss: 1.0651 | Train Accuracy: 0.6700
• Test Loss: 0.8339 | Test Accuracy: 0.7313

Epoch 2/4

• Train Loss: 0.6496 | Train Accuracy: 0.7879
• Test Loss: 0.6988 | Test Accuracy: 0.7717

Epoch 3/4

• Train Loss: 0.4223 | Train Accuracy: 0.8736
• Test Loss: 0.7308 | Test Accuracy: 0.7704

Epoch 4/4

• Train Loss: 0.2764 | Train Accuracy: 0.9150
• Test Loss: 0.7615 | Test Accuracy: 0.7826

Training Completed

Model Evaluation

• Precision Score: 0.7836
• Recall Score: 0.7827
• F1 Score: 0.7820

Classification Report

• Accuracy Score: 0.7827
• Balanced Accuracy Score: 0.7091
• Macro Average: 0.74 (Precision), 0.71 (Recall), 0.72 (F1-Score)
• Weighted Average: 0.78 (Precision), 0.78 (Recall), 0.78 (F1-Score)

How to Use the Model

To use this model, you can load it using the transformers library from Hugging Face.

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-classification", model="Rendika/Trained-indobertweet-balanced-dataset")

# Load model directly
from transformers import AutoTokenizer, AutoModelForSequenceClassification

tokenizer = AutoTokenizer.from_pretrained("Rendika/Trained-indobertweet-balanced-dataset")
model = AutoModelForSequenceClassification.from_pretrained("Rendika/Trained-indobertweet-balanced-dataset")

Conclusion

This IndoBERTweet model is fine-tuned on a balanced dataset to enhance its performance across different categories. The model demonstrates good performance metrics, making it suitable for a variety of text classification tasks in the Indonesian language.

Feel free to use and contribute to this repository. For any issues or suggestions, please open an issue on the repository or contact the maintainer.

---