Downloads · 30 days
47
4% of all-time downloads
MohammadReza-Halakoo/persian-whisper-large-v3-10-percent-17-0-one-epoch
persian-whisper-large-v3-10-percent-17-0-one-epoch is a machine learning model from MohammadReza-Halakoo. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
should probably proofread and complete it, then remove this comment. --
Downloads · 30 days
47
4% of all-time downloads
All-time downloads
1.1K
Public
Parameters
1.5B
6.2 GB on disk
Likes
2
Public
Click a slice to open those files.
.safetensors6.2 GB · 100%
From the Hugging Face model README
This model is a fine-tuned version of openai/whisper-large-v3on the Common Voice 17.0 dataset in Persian. The model has been trained for Automatic Speech Recognition (ASR) and is capable of converting spoken Persian into text. The following sections provide more details on its performance, intended uses, training data, and the procedure followed during training. It achieves the following results on the evaluation set:
This model leverages the Whisper architecture, known for its effectiveness in multilingual ASR tasks. Whisper models are trained on a large corpus of multilingual and multitask supervised data, enabling them to generalize well across different languages, including low-resource languages like Persian. This fine-tuned model is specifically adapted for Persian, improving its accuracy on Persian speech recognition tasks.
This model is designed for speech-to-text tasks in the Persian language. It can be used for applications like transcription of audio files, voice-controlled systems, and any task requiring accurate conversion of spoken Persian into text. However, the model may have limitations when dealing with noisy audio environments, diverse accents, or highly technical vocabulary not present in the training data. It's recommended to fine-tune the model further if your use case involves specialized language or contexts.
The model was fine-tuned using the Common Voice 17.0 dataset, which is a crowd-sourced dataset containing diverse voices in Persian. The dataset was split into training, validation, and test sets. The training set includes a variety of speakers, ages, and accents, making the model robust across different dialects of Persian. The test split used for evaluation represents approximately 10% of the total data, ensuring a reliable assessment of the model's performance.
The following hyperparameters were used during training:
During training, the model achieved the following results:
| Training Loss | Epoch | Step | Validation Loss | Wer |
|---|---|---|---|---|
| 0.2083 | 1.0 | 987 | 0.4072 | 38.9451 |
These results highlight the model's ability to perform well on the given dataset, though there may be room for further optimization and fine-tuning.
The model was trained using the following versions of libraries:
Transformers: 4.44.0, which provides the necessary tools and APIs to fine-tune transformer models like Whisper.
Pytorch: 2.4.0+cu121, the deep learning framework used to build and train the model.
Datasets: 2.21.0, which facilitated the loading and preprocessing of the Common Voice dataset.
Tokenizers: 0.19, used for efficiently handling text tokenization required by the model.
Transformers 4.44.0
Pytorch 2.4.0+cu121
Datasets 2.21.0
Tokenizers 0.19.1