Downloads · 30 days
15
1% of all-time downloads
whisper-base-cantonese
Oblivion208/whisper-base-cantonese
whisper-base-cantonese is a automatic speech recognition model from Oblivion208. Use it when you need speech turned into text. It is set up for transformers. The card lists the license as apache-2.0.
<p align="left" 🤗 <a href="https://huggingface.co/Oblivion208" target="blank"HF Repo</a •🐱 <a href="https://github.com/fengredrum/finetune-whisper-lora" target="blank"Github Repo</a </p
All-time downloads
1.1K
Public
Repo size
1.2 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.pt581 MB · 67%
At a glance
- Task
- Automatic Speech Recognition
- Library
- transformers
- License
- apache-2.0
- Model type
- whisper
- Access
- Public
- Created
- Aug 28, 2023
- Updated
- Aug 30, 2023
- SHA
- 4a9da4f4
Model card
From the Hugging Face model README
<p align="left">
🤗 <a href="https://huggingface.co/Oblivion208" target="_blank">HF Repo</a> •🐱 <a href="https://github.com/fengredrum/finetune-whisper-lora" target="_blank">Github Repo</a>
</p>
Approximate Performance Evaluation
The following models are all trained and evaluated on a single RTX 3090 GPU.
Cantonese Test Results Comparison
MDCC
| Model name | Parameters | Finetune Steps | Time Spend | Training Loss | Validation Loss | CER % | Finetuned Model |
|---|---|---|---|---|---|---|---|
| whisper-tiny-cantonese | 39 M | 3200 | 4h 34m | 0.0485 | 0.771 | 11.10 | Link |
| whisper-base-cantonese | 74 M | 7200 | 13h 32m | 0.0186 | 0.477 | 7.66 | Link |
| whisper-small-cantonese | 244 M | 3600 | 6h 38m | 0.0266 | 0.137 | 6.16 | Link |
| whisper-small-lora-cantonese | 3.5 M | 8000 | 21h 27m | 0.0687 | 0.382 | 7.40 | Link |
| whisper-large-v2-lora-cantonese | 15 M | 10000 | 33h 40m | 0.0046 | 0.277 | 3.77 | Link |
Common Voice Corpus 11.0
| Model name | Original CER % | w/o Finetune CER % | Jointly Finetune CER % |
|---|---|---|---|
| whisper-tiny-cantonese | 124.03 | 66.85 | 35.87 |
| whisper-base-cantonese | 78.24 | 61.42 | 16.73 |
| whisper-small-cantonese | 52.83 | 31.23 | / |
| whisper-small-lora-cantonese | 37.53 | 19.38 | 14.73 |
| whisper-large-v2-lora-cantonese | 37.53 | 19.38 | 9.63 |
- Task
- Automatic Speech Recognition
- Library
- transformers
- Type
- whisper
- License
- apache-2.0
- Languages
- yue
- Created
- Aug 28, 2023
- Updated
- Aug 30, 2023