Downloads · 30 days
82
9% of all-time downloads
whisper-tiny-swiss-german
nizarmichaud/whisper-tiny-swiss-german
whisper-tiny-swiss-german is a automatic speech recognition model from nizarmichaud. Use it when you need speech turned into text. It is set up for transformers. The card lists the license as mit.
Fine-tuned Whisper-tiny on SwissDial-ZH dataset for Swiss German dialects.
All-time downloads
867
Public
Parameters
37.8M
449 MB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.pt298 MB · 66%
At a glance
- Task
- Automatic Speech Recognition
- Library
- transformers
- License
- mit
- Model type
- whisper
- Access
- Public
- Created
- Jun 5, 2024
- Updated
- Nov 5, 2024
- SHA
- 6fad4d97
Model card
From the Hugging Face model README
Model Description
Fine-tuned Whisper-tiny on SwissDial-ZH dataset for Swiss German dialects.
Model Details
- Model Name: nizarmichaud/whisper-tiny-swiss-german
- Base Model: Whisper-tiny-v3
- Dataset: SwissDial-ZH (8 Swiss German dialects): https://mtc.ethz.ch/publications/open-source/swiss-dial.html
- Languages: Swiss German
Training
- Duration: 4 hours
- Hardware: NVIDIA RTX 3080
- Batch Size: 32
- Train/Test Split: 90%/10% (specific sentence selection)
Performance
- WER: ~37% on test set
Usage
from transformers import WhisperForConditionalGeneration, WhisperProcessor
model_name = "nizarmichaud/whisper-tiny-swiss-german"
model = WhisperForConditionalGeneration.from_pretrained(model_name)
processor = WhisperProcessor.from_pretrained(model_name)
audio_input = ... # Your audio input here
inputs = processor(audio_input, return_tensors="pt", sampling_rate=16000)
generated_ids = model.generate(inputs["input_features"])
transcription = processor.batch_decode(generated_ids, skip_special_tokens=True)
print(transcription)
license: mit
- Task
- Automatic Speech Recognition
- Library
- transformers
- Type
- whisper
- License
- mit
- Languages
- de
- Created
- Jun 5, 2024
- Updated
- Nov 5, 2024