Downloads · 30 days
11
30% of all-time downloads
sanke/trelis-mlx-hinglish-q4
trelis-mlx-hinglish-q4 is a automatic speech recognition model from sanke. Use it when you need speech turned into text. It is set up for mlx. The card lists the license as cc-by-nc-4.0.
This is a 4-bit MLX quantized version of the Trelis/whisper-hinglish-preview model by Trelis Research.
Downloads · 30 days
11
30% of all-time downloads
All-time downloads
37
Public
Repo size
878 MB
Likes
0
Public
Click a slice to open those files.
.safetensors878 MB · 100%
From the Hugging Face model README
This is a 4-bit MLX quantized version of the Trelis/whisper-hinglish-preview model by Trelis Research.
The original model (a fine-tune of whisper-large-v3 for English/Hindi code-switching) has been unsharded and converted to the MLX format with 4-bit quantization. This reduces the memory footprint from ~3.1 GB down to ~733 MB, allowing it to run extremely fast on Apple Silicon (M-series) Macs while maintaining high accuracy.
You can load and run this model using the mlx-whisper package:
import mlx_whisper
text = mlx_whisper.transcribe(
"audio.wav",
path_or_hf_repo="sanke/trelis-mlx-hinglish-q4"
)
print(text["text"])