Downloads · 30 days
42
27% of all-time downloads
Japanese_Fine_Tuned_Whisper_Model
NadiaHolmlund/Japanese_Fine_Tuned_Whisper_Model
Japanese_Fine_Tuned_Whisper_Model is a automatic speech recognition model from NadiaHolmlund. Use it when you need speech turned into text. It is set up for transformers. The card lists the license as apache-2.0.
This model is a fine-tuned version of openai/whisper-tiny on the Common Voice dataset. It achieves the following results on the evaluation set: - Loss: 0.780524 - Wer: 301.625840
All-time downloads
155
Public
Repo size
756 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin151 MB · 99%
At a glance
- Task
- Automatic Speech Recognition
- Library
- transformers
- License
- apache-2.0
- Model type
- whisper
- Access
- Public
- Created
- Mar 12, 2023
- Updated
- Mar 13, 2023
- SHA
- 0936f260
Model card
From the Hugging Face model README
Japanese_Fined_Tuned_Whisper_Model
This model is a fine-tuned version of openai/whisper-tiny on the Common Voice dataset. It achieves the following results on the evaluation set:
- Loss: 0.780524
- Wer: 301.625840
Model description
The tiny Whisper model is fine-tuned on Japanese speech samples from the Common Voice dataset, based on which users can perform Automatic Speech Recognition in real time in Japanese.
Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 1e-05
- train_batch_size: 16
- eval_batch_size: 8
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- lr_scheduler_warmup_steps: 500
- training_steps: 4000
- mixed_precision_training: Native AMP
Training results
| Training Loss | Step | Validation Loss | Wer |
|---|---|---|---|
| 0.4766 | 1000 | 0.739755 | 140.797746 |
| 0.3136 | 2000 | 0.720202 | 190.830262 |
| 0.1756 | 3000 | 0.773473 | 215.47997 |
| 0.1472 | 4000 | 0.780524 | 301.625840 |
Framework versions
- Transformers 4.27.0.dev0
- Pytorch 1.13.1+cu116
- Datasets 2.10.1
- Tokenizers 0.13.2
- Task
- Automatic Speech Recognition
- Library
- transformers
- Type
- whisper
- License
- apache-2.0
- Languages
- ja
- Created
- Mar 12, 2023
- Updated
- Mar 13, 2023