CaptainA_v0

# CaptainA_XLS-R_entropy-10_v0

This model is a fine-tuned version of facebook/wav2vec2-xls-r-300m on the Finnish Parliament Corpus with 210h of slow and clean samples. It achieves the following results on the evaluation set (70h of the slow and clean samples from the same corpus):

• Loss: 196.9006
• Cer: 0.0178
• Wer: 0.0592

Model description

This model is used in the CaptainA app.

Intended uses & limitations

The model was fine-tuned with entropy regularization to improve generalization for the Finnish L2 MDD task. Even though the model was trained for the purpose of MDD for L2 Finnish speakers, it was not fine-tuned with any L2 data due to the lack of proper corpus for Finnish L2 MDD.

Therefore, it is important to note that this model is NOT intended for Finnish L2 ASR and will need to be improved further even for the MDD task (hence the model version is 0).

Because the model was fine-tuned with the Finnish Parliament Corpus, it has the same biases from that corpus. The biases are more notable since the model's intended uses are for L2 Finnish speakers. More detail can be read in the Master's thesis: A Mobile App For Practicing Finnish Pronunciation Using Wav2vec 2.0

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 5e-05
• train_batch_size: 128
• eval_batch_size: 128
• seed: 1011
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• lr_scheduler_warmup_steps: 500
• num_epochs: 10.0
• mixed_precision_training: Native AMP

Training results

Framework versions

• Transformers 4.18.0
• Pytorch 1.12.0.dev20220305
• Datasets 1.18.4.dev0
• Tokenizers 0.11.6