phobert-base_ABSA_finetuned

PhoBERT Base for Aspect-Based Sentiment Analysis (Vietnamese)

1. Model Description

This model is a fine-tuned version of vinai/phobert-base for the task of Aspect-Based Sentiment Analysis (ABSA) on Vietnamese text. It is optimized specifically for the Vietnamese language, providing high accuracy in identifying sentiments (Positive, Neutral, Negative) for specific aspects.

• Language: Vietnamese
• Model Type: Transformer-based Encoder
• Base Model: vinai/phobert-base

2. Training Data

The model was trained on Vietnamese ABSA datasets including thinhntr/absa and LuongPhan/UIT-ViSFD.

3. Training Procedure

Hyperparameters:

• Learning Rate: 5e-5
• Batch Size: 32
• Precision: Mixed precision (fp16)
• Epochs: 3

4. Evaluation Results

The model was evaluated on the test set (9141 samples).

• Accuracy: 88.92%
• F1-Macro: 83.73%

Classification Report:

5. How to Use

from transformers import AutoTokenizer, AutoModelForSequenceClassification

tokenizer = AutoTokenizer.from_pretrained("ZycckZ/phobert-base_ABSA_finetuned")
model = AutoModelForSequenceClassification.from_pretrained("ZycckZ/phobert-base_ABSA_finetuned")