Downloads · 30 days
0
whisper-small-it-multi-ggml
LocalAI-io/whisper-small-it-multi-ggml
whisper-small-it-multi-ggml is a automatic speech recognition model from LocalAI-io. Use it when you need speech turned into text. The card lists the license as mit.
whisper.cpp GGML quantizations of LocalAI-io/whisper-small-it-multi for fast CPU/GPU inference.
Access
Public
Updated May 24, 2026
Repo size
1.1 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin1.1 GB · 100%
At a glance
- Task
- Automatic Speech Recognition
- License
- mit
- Access
- Public
- Created
- Apr 25, 2026
- Updated
- May 24, 2026
- SHA
- b8beb1e1
Base models
Model card
From the Hugging Face model README
whisper-small-it-multi-ggml
whisper.cpp GGML quantizations of LocalAI-io/whisper-small-it-multi for fast CPU/GPU inference.
Author: Ettore Di Giacinto
Brought to you by the LocalAI team. These models can be used directly with LocalAI and any whisper.cpp-based runtime.
Files
| File | Quantization | Description |
|---|---|---|
ggml-model-f16.bin | float16 | Full precision (no quantization) — highest quality |
ggml-model-q8_0.bin | int8 | 8-bit quantization — minimal quality loss |
ggml-model-q5_0.bin | int5 | 5-bit quantization — good quality/size tradeoff |
ggml-model-q4_0.bin | int4 | 4-bit quantization — smallest size, fastest |
Training
Fine-tuned openai/whisper-small (244M params) on Common Voice 25.0 + MLS + VoxPopuli + FLEURS Italian.
See LocalAI-io/whisper-small-it-multi for the full safetensors model and detailed WER results.
Usage
whisper.cpp
# Download a quant
huggingface-cli download LocalAI-io/whisper-small-it-multi-ggml ggml-model-q5_0.bin --local-dir .
# Run
./whisper-cli -m ggml-model-q5_0.bin -f audio.wav -l it
whisper.cpp Python bindings (pywhispercpp)
from pywhispercpp.model import Model
model = Model("ggml-model-q5_0.bin", language="it")
segments = model.transcribe("audio.wav")
for seg in segments:
print(seg.text)
LocalAI
# In your LocalAI model config
name: whisper-small-it-multi
backend: whisper
parameters:
model: ggml-model-q5_0.bin
Links
- HF Safetensors: LocalAI-io/whisper-small-it-multi
- CTranslate2 INT8: LocalAI-io/whisper-small-it-multi-ct2-int8
- Code: github.com/mudler/italian-asr
- whisper.cpp: github.com/ggerganov/whisper.cpp
- LocalAI: github.com/mudler/LocalAI
- Task
- Automatic Speech Recognition
- License
- mit
- Languages
- it
- Created
- Apr 25, 2026
- Updated
- May 24, 2026