Downloads · 30 days
0
Numbat/ggml-skyrim-whisper-models
ggml-skyrim-whisper-models is a machine learning model from Numbat. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
The skyrim Metric (Phrase Error Rate) measures how often a transcription omits short, pre-defined target phrases (Skyrim fantasy names) that are present in the reference. A phrase contributes one error if it appears i…
Downloads · 30 days
0
Access
Public
Updated Jun 12, 2025
Repo size
2.2 GB
Likes
0
Public
Click a slice to open those files.
.bin2.2 GB · 100%
From the Hugging Face model README
The skyrim Metric (Phrase Error Rate) measures how often a transcription omits short,
pre-defined target phrases (Skyrim fantasy names) that are present in the reference.
A phrase contributes one error if it appears in the reference but not in
the prediction; otherwise it contributes zero.
The metric averages those 0/1 errors across all testable phrase occurrences.
========== LARGE V3 TURBO RESULTS ===============
Model │ Metric │ Test-set │ Score
───────────┼─────────┼───────────────────┼──────────
BASE │ skyrim │ test-skyrim │ 0.34217
BASE │ wer │ test-commonvoice │ 0.40232
FINETUNED │ skyrim │ test-skyrim │ 0.12825
FINETUNED │ wer │ test-commonvoice │ 0.41662
===================================================
========== SMALL RESULTS ==========
Model │ Metric │ Test-set │ Score
───────────┼─────────┼───────────────────┼──────────
BASE │ skyrim │ test-skyrim │ 0.41378
BASE │ wer │ test-commonvoice │ 0.41957
FINETUNED │ skyrim │ test-skyrim │ 0.15350
FINETUNED │ wer │ test-commonvoice │ 0.43766
=====================================