Downloads · 30 days
0
hfendpoints-images/asr-multilingual-whisper
asr-multilingual-whisper is a automatic speech recognition model from hfendpoints-images. Use it when you need speech turned into text. The card lists the license as apache-2.0.
Deploy OpenAI's Whisper Inference Endpoint to transcribe audio files to text in many languages
Downloads · 30 days
0
Access
Public
Updated Apr 25, 2025
Repo size
—
Likes
10
Public
Click a slice to open those files.
.py18.6 KB · 75%
From the Hugging Face model README
Deploy OpenAI's Whisper Inference Endpoint to transcribe audio files to text in many languages
Resulting deployment exposes an OpenAI Platform Transcription compatible HTTP endpoint
which you can query using the OpenAi Libraries or directly through cURL for instance.
| path | description |
|---|---|
| /api/v1/audio/transcriptions | Transcription endpoint to interact with the model |
| /docs | Visual documentation |
curl http://localhost:8000/api/v1/audio/transcriptions \
--request POST \
--header 'Content-Type: multipart/form-data' \
-F file=@</path/to/audio/file> \
-F "response_format": "text"
curl http://localhost:8000/api/v1/audio/transcriptions \
--request POST \
--header 'Content-Type: multipart/form-data' \
-F file=@</path/to/audio/file> \
-F "response_format": "json"
curl http://localhost:8000/api/v1/audio/transcriptions \
--request POST \
--header 'Content-Type: multipart/form-data' \
-F file=@</path/to/audio/file> \
-F "response_format": "verbose_json"
| spec | value | description |
|---|---|---|
| Engine | vLLM (v0.8.3) | Underlying inference engine leverages vLLM |
| Hardware | GPU (Ada Lovelace) | Requires the target endpoint to run over NVIDIA GPUs with at least compute capabilities 8.9 (Ada Lovelace) |
| Compute data type | bfloat16 | Computations (matmuls, norms, etc.) are done using bfloat16 precision |
| KV cache data type | float8 (e4m3) | Key-Value cache is stored on the GPU using float8 (float8_e4m3) precision to save space |
| PyTorch Compile | ✅ | Enable the use of torch.compile to further optimize model's execution with more optimizations |
| CUDA Graphs | ✅ | Enable the use of so called "CUDA Graphs" to reduce overhead executing GPU computations |