Downloads · 30 days
4
5% of all-time downloads
jessicalzhou/whisper-small-finetuned-medical3
whisper-small-finetuned-medical3 is a automatic speech recognition model from jessicalzhou. Use it when you need speech turned into text. It is set up for transformers. The card lists the license as apache-2.0.
should probably proofread and complete it, then remove this comment. --
Downloads · 30 days
4
5% of all-time downloads
All-time downloads
83
Public
Parameters
242M
1.5 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors967 MB · 66%
From the Hugging Face model README
This model is a fine-tuned version of openai/whisper-small on the audiofolder dataset. It achieves the following results on the evaluation set:
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss | Wer |
|---|---|---|---|---|
| 0.4797 | 0.8696 | 10 | 0.4806 | 5.8239 |
| 0.4503 | 1.6957 | 20 | 0.4695 | 5.6818 |
| 0.4076 | 2.5217 | 30 | 0.4219 | 5.5398 |
| 0.3637 | 3.3478 | 40 | 0.3402 | 4.8295 |
| 0.2583 | 4.1739 | 50 | 0.1697 | 4.1193 |
| 0.1121 | 5.0 | 60 | 0.0978 | 3.8352 |
| 0.0751 | 5.8696 | 70 | 0.0825 | 3.8352 |
| 0.0464 | 6.6957 | 80 | 0.0671 | 3.125 |
from transformers import pipeline
import gradio as gr
# Load the fine-tuned Whisper model for medical speech recognition
pipe = pipeline(model="Johnyquest7/whisper-small-finetuned-medical3", return_timestamps=True)
# Define transcription function
def transcribe(audio):
text = pipe(audio)["text"]
return text
# Create a Gradio interface
iface = gr.Interface(
fn=transcribe,
inputs=gr.Audio(sources=["upload", "microphone"], type="filepath"),
outputs="text",
title="Whisper Small Medical",
description="Demo for medical speech recognition using a fine-tuned Whisper small model."
)
# Launch the interface
iface.launch()