Downloads · 30 days
11
5% of all-time downloads
ayameRushia/whisper-v3-turbo-id
whisper-v3-turbo-id is a automatic speech recognition model from ayameRushia. Use it when you need speech turned into text. It is set up for transformers. The card lists the license as mit.
should probably proofread and complete it, then remove this comment. --
Downloads · 30 days
11
5% of all-time downloads
All-time downloads
235
Public
Parameters
809M
6.5 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors3.2 GB · 100%
From the Hugging Face model README
This model is a fine-tuned version of ayameRushia/whisper-v3-turbo-id on the common_voice_17_0 dataset. It achieves the following results on the evaluation set:
Fine tuned from openai/whisper-v3-turbo
This model only trained using common voice version 17
Preprocess data
import re
chars_to_ignore_regex = '[\,\?\.\!\;\:\"\”\’\'\“\(\)\[\\\\&/!\‘]' # delete following chars
chars_to_space_regex = '[\–\—\-]' # replace the following chars into space
def remove_special_characters(batch):
batch["sentence"] = re.sub(chars_to_ignore_regex, '', batch["sentence"]).lower() + " "
batch["sentence"] = re.sub(chars_to_space_regex, ' ', batch["sentence"]) + " "
# replacing some character
batch["sentence"] = batch["sentence"].replace("é", "e").replace("á", "a").replace("ł", "l").replace("ń", "n").replace("ō", "o").strip()
return batch
common_voice = common_voice.map(remove_special_characters)
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss | Wer |
|---|---|---|---|---|
| 0.0706 | 1.9231 | 1000 | 0.2361 | 18.0484 |
| 0.0099 | 3.8462 | 2000 | 0.1875 | 10.3607 |
| 0.001 | 5.7692 | 3000 | 0.1760 | 9.1737 |