Downloads · 30 days
842
6% of all-time downloads
JackyHoCL/whisper-large-v3-turbo-cantonese-yue-english
whisper-large-v3-turbo-cantonese-yue-english is a automatic speech recognition model from JackyHoCL. Use it when you need speech turned into text. It is set up for transformers. The card lists the license as mit.
---------------------------------------------------------------
Downloads · 30 days
842
6% of all-time downloads
All-time downloads
13.5K
Public
Parameters
809M
22.6 GB on disk
Likes
15
Public
Click a slice to open those files.
.safetensors3.2 GB · 100%
From the Hugging Face model README
TODO: <br/> 1.Improve zh-CN performance <br/> 2.Improve overall performance (yue+zh+en) with background noise (Please kindly suggest/provide dataset if possible, thx) <br/>
temperature=0.3, extra_body=dict( seed=4419, repetition_penalty=1.05, top_p=0.5 )
2025-07-21: CER:
| Dataset | Lang | Split | CER(in %) |
|---|---|---|---|
| Training | yue | validation | 8.05 |
| mozilla-foundation/common_voice_17_0 | yue | test | 0.64 |
| JackyHoCL/cleaned_mixed_cantonese_and_english_speech | yue | test | 8.3 |
| mozilla-foundation/common_voice_17_0 | en | test(2k samples) | 5.22 |
| mozilla-foundation/common_voice_16_1 | zh-CN | test | 11.89 |
2025-07-19: CER:
| Dataset | Lang | Split | CER(in %) |
|---|---|---|---|
| Training | yue | validation | 8.94 |
| mozilla-foundation/common_voice_17_0 | yue | test | 1.29 |
| JackyHoCL/cleaned_mixed_cantonese_and_english_speech | yue | test | 8.00 |
| mozilla-foundation/common_voice_17_0 | en | test | 6.8 |
| mozilla-foundation/common_voice_16_1 | zh-CN | test | 50.9 |
2025-07-06: CER:
| Dataset | Lang | Split | CER(in %) |
|---|---|---|---|
| Training | yue | validation | 8.92 |
| mozilla-foundation/common_voice_17_0 | yue | test | 8.86 |
| JackyHoCL/cleaned_mixed_cantonese_and_english_speech | yue | test | 7.96 |
| mozilla-foundation/common_voice_17_0 | en | test | 6.84 |
| mozilla-foundation/common_voice_16_1 | zh-CN | test | 43.0 |
per_device_train_batch_size=32,<br/> learning_rate=1e-7,<br/>
2025-07-03: CER:
| Dataset | Lang | Split | CER(in %) |
|---|---|---|---|
| Training | yue | validation | 9.705 |
| mozilla-foundation/common_voice_17_0 | yue | test | 9.31 |
| JackyHoCL/cleaned_mixed_cantonese_and_english_speech | yue | test | 8.37 |
per_device_train_batch_size=32,<br/> learning_rate=1e-5,<br/>
CER: 13.7% <br/>
Train Args:<br/> per_device_train_batch_size=16,<br/> gradient_accumulation_steps=1,<br/> learning_rate=1e-5,<br/> gradient_checkpointing=True,<br/> per_device_eval_batch_size=16,<br/> generation_max_length=225,<br/>
Hardware:<br/> NVIDIA Tesla V100 16GB * 4<br/>
A Realtime Streaming application example is built on this model:<br/> https://github.com/JackyHoCL/whisper-realtime.git <br/>
FAQ:
pip install --upgrade transformers