Downloads · 30 days
8
7% of all-time downloads
kirandevraj/whisper-medium-supreme-court-hybrid
whisper-medium-supreme-court-hybrid is a automatic speech recognition model from kirandevraj. Use it when you need speech turned into text. It is set up for transformers. The card lists the license as apache-2.0.
A full fine-tune of openai/whisper-medium (all 763M parameters) on the kirandevraj/supreme-court-hearings-asr dataset — 46.9 h of Indian Supreme Court hearing audio, sentence-aligned by a best-of-both
Downloads · 30 days
8
7% of all-time downloads
All-time downloads
112
Public
Parameters
764M
3.1 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors3.1 GB · 100%
From the Hugging Face model README
A full fine-tune of openai/whisper-medium
(all 763M parameters) on the kirandevraj/supreme-court-hearings-asr
dataset — 46.9 h of Indian Supreme Court hearing audio, sentence-aligned by a best-of-both
(MMS-CTC + Whisper) forced-alignment pipeline.
Whisper BasicTextNormalizer applied to both sides; WER/CER via jiwer. Trained on the
by-case train split (24,422 clips); both eval sets are held out (the gold hearing is never
trained on). Best checkpoint selected by validation WER.
| Eval set | Model | WER | CER |
|---|---|---|---|
| Held-out test (3,799) | whisper-medium · zero-shot | 12.6 | 7.2 |
| Held-out test (3,799) | whisper-medium · fine-tuned (this) | 9.2 | 5.2 |
| Human-verified gold (109) | whisper-medium · zero-shot | 25.0 | 18.1 |
| Human-verified gold (109) | whisper-medium · fine-tuned (this) | 14.6 | 10.3 |
Validation WER during training reached 9.53 (CER 5.99). Fine-tuning cuts test WER ~27% relative and gold WER ~42% relative over zero-shot whisper-medium.
openai/whisper-medium (769M), full fine-tune (no LoRA)1e-5, 50-step warmup, bf16, gradient checkpointingimport torch
from transformers import pipeline
asr = pipeline(
"automatic-speech-recognition",
model="kirandevraj/whisper-medium-supreme-court-hybrid",
torch_dtype=torch.float16,
device=0, # GPU; use -1 for CPU
)
out = asr("hearing_clip.wav", generate_kwargs={"language": "en", "task": "transcribe"})
print(out["text"])
Lower-level (processor + model):
import torch, soundfile as sf
from transformers import WhisperForConditionalGeneration, WhisperProcessor
repo = "kirandevraj/whisper-medium-supreme-court-hybrid"
proc = WhisperProcessor.from_pretrained(repo)
model = WhisperForConditionalGeneration.from_pretrained(repo, torch_dtype=torch.float16).to("cuda").eval()
audio, sr = sf.read("hearing_clip.wav") # 16 kHz mono
feats = proc(audio, sampling_rate=16000, return_tensors="pt").input_features.to("cuda", torch.float16)
ids = model.generate(feats, language="en", task="transcribe")
print(proc.batch_decode(ids, skip_special_tokens=True)[0])