Downloads · 30 days
6
0% of all-time downloads
AntonyG/fine-tune-wav2vec2-large-xls-r-1b-sw
fine-tune-wav2vec2-large-xls-r-1b-sw is a automatic speech recognition model from AntonyG. Use it when you need speech turned into text. It is set up for transformers. The card lists the license as apache-2.0.
should probably proofread and complete it, then remove this comment. --
Downloads · 30 days
6
0% of all-time downloads
All-time downloads
8.7K
Public
Repo size
11.4 GB
Likes
0
Public
Click a slice to open those files.
.bin1.3 GB · 100%
From the Hugging Face model README
This model is a fine-tuned version of facebook/wav2vec2-xls-r-300m on the common_voice_11_0 swahili dataset. It achieves the following results on the evaluation set:
This model is fine-tuned for general swahili speech recognition tasks. You can watch our hour long webinar and see the slides on this work.
The intention is to transcribe general swahili speeches. With further development, we'll fine-tune the model for domain-specific (we are focused on hospital tasks) swahili conversations.
To appreciate the transformation we did on the data, you can read our blog on data preparation.
We also documented some lessons from the fine-tuning exercise.
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss | Wer |
|---|---|---|---|---|
| No log | 1.72 | 200 | 3.0092 | 1.0 |
| 4.1305 | 3.43 | 400 | 2.9159 | 1.0 |
| 4.1305 | 5.15 | 600 | 1.4301 | 0.7040 |
| 0.9217 | 6.87 | 800 | 1.3143 | 0.6529 |
| 0.9217 | 8.58 | 1000 | 1.2834 | 0.5834 |