distilbert-finetuned-imdb

Model Distilbert fine-tuned with imdb reviews for sentiment analysis

from transformers import DistilBertForSequenceClassification, DistilBertTokenizerFast

model = DistilBertForSequenceClassification.from_pretrained("./distilbert-finetuned-imdb") tokenizer = DistilBertTokenizerFast.from_pretrained("./distilbert-finetuned-imdb")

Epoch Training Loss Validation Loss Accuracy 1 0.224900 0.223101 0.913040 2 0.152700 0.241866 0.929960 3 0.089300 0.280867 0.932440

TrainOutput(global_step=4689, training_loss=0.16640237623960333, metrics={'train_runtime': 2933.7121, 'train_samples_per_second': 25.565, 'train_steps_per_second': 1.598, 'total_flos': 9935054899200000.0, 'train_loss': 0.16640237623960333, 'epoch': 3.0})

{'eval_loss': 0.28086698055267334, 'eval_accuracy': 0.93244, 'eval_runtime': 246.0564, 'eval_samples_per_second': 101.603, 'eval_steps_per_second': 6.352, 'epoch': 3.0}