Downloads · 30 days
4
17% of all-time downloads
WhisperCheckpoints3
Yulle/WhisperCheckpoints3
WhisperCheckpoints3 is a automatic speech recognition model from Yulle. Use it when you need speech turned into text. It is set up for transformers. The card lists the license as apache-2.0.
Whisper is a state-of-the-art automatic speech recognition(ASR) model created by OpenAI. It is able to translate and transcribe multiple different languages. In this project the "small" Whisper model with 244M paramet…
All-time downloads
24
Public
Parameters
242M
6.8 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors967 MB · 100%
At a glance
- Task
- Automatic Speech Recognition
- Library
- transformers
- License
- apache-2.0
- Model type
- whisper
- Access
- Public
- Created
- Dec 3, 2023
- Updated
- Dec 10, 2023
- SHA
- 50e7568a
Model card
From the Hugging Face model README
Fine-tuning Whisper model on Swedish audio dataset
Whisper is a state-of-the-art automatic speech recognition(ASR) model created by OpenAI. It is able to translate and transcribe multiple different languages. In this project the "small" Whisper model with 244M parameters was used. The dataset that wasa used for fine-tuning the Whisper model was the Swedish subset of the Mozilla foundation common voice 11 dataset.
Each audio in the dataset will be truncated or padded to 30 second snippets and then converted to the log-Mel spectrogram. Once they are in the form of log-Mel spectrograms they will be sent into the Whisper model architecture. Training was done on Google Colab and during the training checkpoints were saved to google drive in case of disconnections. Additionally the models were also pushed to a huggingface model repo along with the tensorboard data to visualize the metrics.
Training Hyperparameters
| Hyperparameter | Value |
|---|---|
| num_train_epochs | 1 |
| per_device_train_batch_size | 16 |
| gradient_accumulation_steps | 1 |
| learning_rate | 1e-5 |
| warmup_steps | 500 |
| max_steps | 4000 |
| gradient_checkpointing | True |
| fp16 | True |
| per_device_eval_batch_size | 8 |
| generation_max_length | 225 |
| save_steps | 500 |
| eval_steps | 500 |
- Task
- Automatic Speech Recognition
- Library
- transformers
- Type
- whisper
- License
- apache-2.0
- Languages
- sv
- Created
- Dec 3, 2023
- Updated
- Dec 10, 2023