AAVE_PoS-Tagger

<!-- This model card has been generated automatically according to the information the Trainer had access to. You should probably proofread and complete it, then remove this comment. -->

bert-finetuned-AAVE-PoS

This model is a version of bert-base-cased fine-tuned on a dataset of African American Vernacular English (AAVE) which was published alongside Jørgensen et al. 2016. It achieves the following results on the evaluation set:

• Loss: 0.2582
• Precision: 0.8632
• Recall: 0.8730
• F1: 0.8681
• Accuracy: 0.9356

Model description

More information needed

Intended uses & limitations

This model is intended to help close the gap in part-of-speech tagging performance between Standard American English (SAE) and African American English (AAVE) which differ liguistically in many well-documented ways. It was fine-tuned on data gathered from Twitter, and is thus ingrained with what linguists call 'register bias'.

Training and evaluation data

Code hosted at GitHub.

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 3 (this amount of data overfits on 3+)

Training results

Framework versions

• Transformers 4.29.2
• Pytorch 1.13.1+cpu
• Datasets 2.12.0
• Tokenizers 0.13.3