Downloads · 30 days
23
1% of all-time downloads
whisper-large-v2-nob
NbAiLabArchive/whisper-large-v2-nob
whisper-large-v2-nob is a automatic speech recognition model from NbAiLabArchive. Use it when you need speech turned into text. It is set up for transformers. The card lists the license as apache-2.0.
This model is a fine-tuned version of openai/whisper-large-v2 trained on several datasets.
All-time downloads
3K
Public
Parameters
1.5B
120 GB on disk
Likes
13
Public
Repo makeup
Click a slice to open those files.
.bin3.1 GB · 50%
At a glance
- Task
- Automatic Speech Recognition
- Library
- transformers
- License
- apache-2.0
- Model type
- whisper
- Access
- Public
- Created
- Dec 14, 2022
- Updated
- Sep 13, 2023
- SHA
- c0c7d846
Model card
From the Hugging Face model README
Whisper Large Norwegian Bokmål
This model is a fine-tuned version of openai/whisper-large-v2 trained on several datasets.
It is currently in the middle of a large training. Currently it achieves the following results on the evaluation set:
- Loss: 0.2477
- Wer: 10.718635559082031
Model description
The model is trained on a large corpus of roughly 5.000 hours of voice. The sources are subtitles from the Norwegian broadcaster NRK, transcribed speeches from the Norwegian parliament and voice recordings from Norsk Språkteknologi.
Intended uses & limitations
The model will be free for everyone to use when it is finished.
Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 3e-06
- train_batch_size: 64
- gradient_accumulation_steps: 2
- eval_batch_size: 32
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: constant with warmpu
- lr_scheduler_warmup_steps: 1000
- training_steps: 50.000 (currently @1.000)
- mixed_precision_training: fp16
- deepspeed: true
Live Training results
- Task
- Automatic Speech Recognition
- Library
- transformers
- Type
- whisper
- License
- apache-2.0
- Languages
- no
- Created
- Dec 14, 2022
- Updated
- Sep 13, 2023