Downloads · 30 days
0
Numbat/skyrim-whisper-large-v3-turbo
skyrim-whisper-large-v3-turbo is a machine learning model from Numbat. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
The skyrim Metric (Phrase Error Rate) measures how often a transcription omits short, pre-defined target phrases (Skyrim fantasy names) that are present in the reference. A phrase contributes one error if it appears i…
Downloads · 30 days
0
Access
Public
Updated Jun 12, 2025
Repo size
3.2 GB
Likes
0
Public
Click a slice to open those files.
Other1.5 KB · 55%
From the Hugging Face model README
The skyrim Metric (Phrase Error Rate) measures how often a transcription omits short, pre-defined target phrases (Skyrim fantasy names) that are present in the reference. A phrase contributes one error if it appears in the reference but not in the prediction; otherwise it contributes zero. The metric averages those 0/1 errors across all testable phrase occurrences.
test-commonvoice uses all but the invalidated items of the delta sets of commonvoice 21 & 20
test-skyrim is ~3000 voicelines from the Game, containing one or more of the words & phrases we wanted the model to learn
========== LARGE V3 TURBO RESULTS ===============
Model │ Metric │ Test-set │ Score
───────────┼─────────┼───────────────────┼──────────
BASE │ skyrim │ test-skyrim │ 0.34217
BASE │ wer │ test-commonvoice │ 0.40232
FINETUNED │ skyrim │ test-skyrim │ 0.12825
FINETUNED │ wer │ test-commonvoice │ 0.41662
===================================================