distilbert-sentiment-model

DistilBERT Sentiment Analysis Model

Overview

This repository contains a fine-tuned DistilBERT model trained for sentiment analysis on TripAdvisor reviews. The model predicts sentiment scores on a scale of 1 to 5 based on review text.

• Base Model: distilbert-base-uncased
• Trained Dataset: nhull/tripadvisor-split-dataset-v2
• Use Case: Sentiment classification for customer reviews to derive insights into customer satisfaction.
• Output: Sentiment labels (1-5).

---

Model Details

• Learning Rate: 3e-05
• Batch Size: 64
• Epochs: 10 (with early stopping)
• Patience: 5 (epochs without improvement)
• Tokenizer: distilbert-base-uncased
• Framework: PyTorch + Hugging Face Transformers

Intended Use

This model is designed to classify hotel reviews based on their sentiment. It assigns a star rating between 1 and 5 to a review, indicating the sentiment expressed in the review.

---

Dataset

The dataset used for training, validation, and testing is nhull/tripadvisor-split-dataset-v2. It consists of:

• Training Set: 30,400 reviews
• Validation Set: 1,600 reviews
• Test Set: 8,000 reviews

All splits are balanced across five sentiment labels.

---

Test Performance

Model predicts too high on average by 0.3934.

Classification Report (Test Set)

Confusion Matrix (Test Set)

---

Files Included

• validation_results_distilbert.csv: Contains correctly classified reviews with their real and predicted labels.

---

Limitations

1. Domain-Specific: The model was trained on TripAdvisor reviews, so it may not generalize to other types of reviews or domains without further fine-tuning.
2. Subjectivity: Sentiment annotations are subjective and may not fully represent every user's perception.
3. Performance: Mid-range sentiment labels (2 and 3) have lower precision and recall compared to extreme sentiment labels (1 and 5).