Downloads · 30 days
93
4% of all-time downloads
nizarmichaud/whisper-large-v3-turbo-swissgerman
whisper-large-v3-turbo-swissgerman is a automatic speech recognition model from nizarmichaud. Use it when you need speech turned into text. It is set up for transformers. The card lists the license as mit.
Due to some datasets' licenses the model had to be taken down.
Downloads · 30 days
93
4% of all-time downloads
All-time downloads
2.6K
Public
Repo size
3.2 GB
Likes
21
Public
Click a slice to open those files.
.json1.5 MB · 65%
From the Hugging Face model README
Due to some datasets' licenses the model had to be taken down.
This repository contains a fine-tuned version of OpenAI's Whisper Large V3 Turbo model, adapted specifically for Swiss German dialects using QLoRa optimization. The model achieves state-of-the-art performance for Swiss German automatic speech recognition (ASR).
The model's performance has been evaluated across multiple datasets representing diverse dialectal and demographic distributions in Swiss German.
The model has been trained and evaluated on a comprehensive suite of Swiss German datasets:
SDS-200 Corpus
STT4SG-350
SwissDial-Zh v1.1
Swiss Parliament Corpus V2 (SPC)
ASGDTS (All Swiss German Dialects Test Set)
| Model | WER (All) | WER SD (All) |
|---|---|---|
| Turbo V3 Swiss German | 0.1672 | 0.1754 |
| Large V3 | 0.2884 | 0.2829 |
| Turbo V3 | 0.4392 | 0.2777 |
| Model | BLEU (All) | BLEU SD (All) |
|---|---|---|
| Turbo V3 Swiss German | 0.65 | 0.3149 |
| Large V3 | 0.5345 | 0.3453 |
| Turbo V3 | 0.3367 | 0.2975 |



This model can be used directly with the Hugging Face Transformers library for tasks requiring Swiss German ASR.
Special thanks to the creators and maintainers of the datasets used in this work:
And to the University of Geneva for allowing us access to their High Performance Computing cluster on which the model has been trained.
If you use this model in your work, please cite this repository as follows:
@misc{whisper-large-v3-turbo-swissgerman,
author = {Nizar Michaud},
title = {Whisper Large V3 Turbo Fine-Tuned for Swiss German},
year = {2024},
publisher = {Hugging Face},
url = {https://huggingface.co/nizarmichaud/whisper-large-v3-turbo-swissgerman},
doi = 10.57967/hf/3858,
}