Downloads · 30 days
6
6% of all-time downloads
ajiayi/bert-full-finetuned-singapore-digi-banks
bert-full-finetuned-singapore-digi-banks is a text classification model from ajiayi. Use it when you need a label for a piece of text. It is set up for transformers. The card lists the license as apache-2.0.
This model is a fully fine-tuned version of distilbert-base-uncased for 5-class star rating prediction (1-5 stars) on Singapore digital bank reviews. All ~67M parameters were updated during training.
Downloads · 30 days
6
6% of all-time downloads
All-time downloads
109
Public
Parameters
67M
268 MB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors268 MB · 100%
From the Hugging Face model README
This model is a fully fine-tuned version of distilbert-base-uncased for 5-class star rating prediction (1-5 stars) on Singapore digital bank reviews. All ~67M parameters were updated during training.
| Metric | Score |
|---|---|
| Test Accuracy | 0.4130 |
| Precision (Macro) | 0.4461 |
| Recall (Macro) | 0.4130 |
| F1-Score (Macro) | 0.3268 |
| MAE (Mean Absolute Error) | 1.0217 stars |
from transformers import AutoModelForSequenceClassification, AutoTokenizer
import torch
# Load model and tokenizer
model = AutoModelForSequenceClassification.from_pretrained("ajiayi/bert-full-finetuned-singapore-digi-banks")
tokenizer = AutoTokenizer.from_pretrained("ajiayi/bert-full-finetuned-singapore-digi-banks")
# Make predictions
text = "Love this bank! Best interest rates in Singapore."
inputs = tokenizer(text, return_tensors="pt", truncation=True, max_length=128)
outputs = model(**inputs)
predicted_stars = outputs.logits.argmax(dim=1).item() + 1 # Convert 0-4 to 1-5
print(f"Predicted rating: {predicted_stars} stars")
distilbert-base-uncased (66M parameters)The model was evaluated on a held-out test set with the following results:
See confusion matrix and detailed per-class metrics in the training notebook.
from transformers import AutoModelForSequenceClassification, AutoTokenizer
import torch
# Load model and tokenizer
model = AutoModelForSequenceClassification.from_pretrained("ajiayi/bert-full-finetuned-singapore-digi-banks")
tokenizer = AutoTokenizer.from_pretrained("ajiayi/bert-full-finetuned-singapore-digi-banks")
# Predict
def predict_rating(text):
inputs = tokenizer(text, return_tensors="pt", truncation=True, max_length=128)
model.eval()
with torch.no_grad():
outputs = model(**inputs)
prediction = outputs.logits.argmax(dim=1).item()
return prediction + 1 # Convert 0-indexed to 1-5 stars
# Example
review = "Great banking app! Very user-friendly interface."
stars = predict_rating(review)
print(f"Predicted: {stars} stars")
@misc{full-finetuned-singapore-banks,
author = {Your Name},
title = {Full Fine-Tuned DistilBERT for Singapore Bank Review Classification},
year = {2025},
publisher = {HuggingFace},
howpublished = {\url{https://huggingface.co/ajiayi/bert-full-finetuned-singapore-digi-banks}}
}
This model is released under the Apache 2.0 License.
Generated: 2025-10-12 00:17:45