Downloads · 30 days
14
18% of all-time downloads
juanjucm/whisper-large-v3-turbo-FLEURS-GL-EN
whisper-large-v3-turbo-FLEURS-GL-EN is a automatic speech recognition model from juanjucm. Use it when you need speech turned into text. It is set up for transformers. The card lists the license as mit.
This model is a fine-tuned version of openai/whisper-large-v3-turbo trained on juanjucm/FLEURS-SpeechT-GL-EN for Galician-to-English Text to Speech Translation task. It takes galician speech audios as input and genera…
Downloads · 30 days
14
18% of all-time downloads
All-time downloads
79
Public
Parameters
809M
12.9 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors3.2 GB · 100%
From the Hugging Face model README
This model is a fine-tuned version of openai/whisper-large-v3-turbo trained on juanjucm/FLEURS-SpeechT-GL-EN for Galician-to-English Text to Speech Translation task. It takes galician speech audios as input and generates the correspondant translated transcription in English.
The motivation behind this work is to increase the visibility of the Galician language, making it more accessible for non-Galician speakers to understand and engage with Galician audio content.
This model was developed during a 3-week Speech Translation workshop organised by Yasmin Moslem.
Baseline model achieved a BLEU score of 5.0 on the evaluation dataset.
After fine-tuning, it achieves the following results on the evaluation set:
The following hyperparameters were used during training:
We used BLEU Score as our reference translation metric for selecting the best checkpoint after training.
| Training Loss | Epoch | Step | Validation Loss | Wer | Bleu |
|---|---|---|---|---|---|
| 4.2751 | 1.0 | 5 | 3.8850 | 76.6962 | 18.0512 |
| 2.3984 | 2.0 | 10 | 2.6965 | 97.0501 | 13.5327 |
| 1.4958 | 3.0 | 15 | 2.2308 | 71.6814 | 18.9665 |
| 1.27 | 4.0 | 20 | 2.0454 | 128.3186 | 12.2446 |