Downloads · 30 days
11
32% of all-time downloads
t5-standard-ABSA
trichter/t5-standard-ABSA
t5-standard-ABSA is a machine learning model from trichter. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers.
All-time downloads
34
Public
Parameters
738M
3 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors3 GB · 100%
At a glance
- Library
- transformers
- Model type
- t5
- Access
- Public
- Created
- Oct 2, 2024
- Updated
- Oct 2, 2024
- SHA
- 51429bbc
Base models
Model card
From the Hugging Face model README
Model: t5-standard-ABSA
Task: Aspect-Based Sentiment Analysis (ABSA) - specifically, Aspect Pair Sentiment Extraction
Model Description
t5-standard-ABSA is a fine-tuned t5-large model designed to perform Aspect-Based Sentiment Analysis (ABSA), particularly for the task of Aspect Pair Sentiment Extraction.
Dataset
The dataset consisted of customer reviews of mobile apps that were originally unannotated. They were scraped and collected by Martens et al. for their paper titled "On the Emotion of Users in App Reviews". The data was annotated via the OpenAI API and the model gpt-3.5-turbo, with each review labeled for specific aspects (e.g., UI, functionality, performance) and the corresponding sentiment (positive, negative, neutral).
Training was performed using Hugging Face's Trainer API in Google Colaboratory using 1 L4 GPU with 22.5 GB of VRAM.
Training took around 3 hours with a cost of about 30 compute units.
All code can be found at my My GitHub Repository
Hyperparameters
Some of the key hyperparameters used for fine-tuning:
Batch Size: 8
Gradient Accumulation Steps: 1
Optimizer: AdamW
Learning Rate: 1e-4
Epochs: 5
Max Sequence Length: 512
- Library
- transformers
- Type
- t5
- Languages
- en
- Created
- Oct 2, 2024
- Updated
- Oct 2, 2024