Downloads · 30 days
17
13% of all-time downloads
ayoubelfallah1/whisper-darija-v3
whisper-darija-v3 is a automatic speech recognition model from ayoubelfallah1. Use it when you need speech turned into text. It is set up for transformers. The card lists the license as apache-2.0.
This model is a fine-tuned version of ilyaslbern7347/whisper-darija-stage1 using a custom dataset of Moroccan Darija flight-related speech.
Downloads · 30 days
17
13% of all-time downloads
All-time downloads
132
Public
Parameters
242M
1.9 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors967 MB · 100%
From the Hugging Face model README
This model is a fine-tuned version of ilyaslbern7347/whisper-darija-stage1 using a custom dataset of Moroccan Darija flight-related speech.
The objective of this model is to improve speech recognition accuracy for Moroccan Darija users searching for flights using natural language.
This model is based on OpenAI Whisper and has been further fine-tuned specifically for Moroccan Darija speech in the travel domain.
The model recognizes spoken requests such as:
This model is intended to be integrated into intelligent flight booking assistants.
This model is suitable for:
This model was fine-tuned only on Moroccan Darija speech related to flight booking.
Performance may decrease for:
The model was trained on a custom Moroccan Darija speech dataset containing flight-related queries.
The dataset includes recordings covering:
| Parameter | Value |
|---|---|
| Learning Rate | 5e-6 |
| Train Batch Size | 8 |
| Eval Batch Size | 8 |
| Gradient Accumulation | 2 |
| Total Batch Size | 16 |
| Warmup Steps | 40 |
| Max Training Steps | 200 |
| Weight Decay | 0.01 |
| FP16 | True |
| Gradient Checkpointing | True |
| Optimizer | AdamW |
| LR Scheduler | Linear |
| Step | Training Loss | Validation Loss | WER |
|---|---|---|---|
| 50 | 1.5132 | 0.4115 | 30.17 |
| 100 | 0.1160 | 0.2923 | 25.51 |
| 150 | 0.0102 | 0.2779 | 23.28 |
| 200 | 0.0048 | 0.2775 | 23.46 |
Best checkpoint:
The model achieved:
This represents a significant improvement over the base model for Moroccan Darija flight-related speech recognition.
The model can transcribe requests such as:
"بغيت نحجز رحلة من كازا لباريس."
"شنو أرخص رحلة لغدا؟"
"بغيت نمشي لطنجة نهار الجمعة."