Downloads · 30 days
6
13% of all-time downloads
aschaler/bert-bank-transaction-classification
bert-bank-transaction-classification is a machine learning model from aschaler. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Bank transaction record classification BERT model for domain specific classification application. This FT BERT model specializes the base 'google-bert/bert-base-uncased' on custom synthetic bank transaction data by ap…
Downloads · 30 days
6
13% of all-time downloads
All-time downloads
46
Public
Repo size
438 MB
Likes
0
Public
Click a slice to open those files.
.safetensors438 MB · 100%
From the Hugging Face model README
Bank transaction record classification BERT model for domain specific classification application. This FT BERT model specializes the base 'google-bert/bert-base-uncased' on custom synthetic bank transaction data by applying a MLP multi class classification head using Linear Probing then Fine-Tunning (LP-FT).
The SFT method unfreezes k final layers of the base model after a warm up step of 3 epochs during FT to improve training and performance of the final classifier. This method minmally extends LP-FT as described in Understanding Linear Probing then Fine-tuning Language Models from NTK Perspective.
Training code loacted at: https://github.com/Andreas3333/model-training/tree/main/bert_for_seq_classification