Downloads · 30 days
0
whisper-v3-large-8bit-quants
nisten/whisper-v3-large-8bit-quants
whisper-v3-large-8bit-quants is a machine learning model from nisten. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Made an 8bit quantized whisper v3 for running via https://github.com/ggerganov/whisper.cpp
Access
Public
Updated Mar 13, 2024
Repo size
16 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin12.7 GB · 100%
At a glance
- License
- apache-2.0
- Access
- Public
- Created
- Mar 13, 2024
- Updated
- Mar 13, 2024
- SHA
- 79dd1aab
Model card
From the Hugging Face model README
Made an 8bit quantized whisper v3 for running via https://github.com/ggerganov/whisper.cpp
Recently converted and quantized from the full float32 model to avoid any errors or loss of precision.
sample command for transcribing a podcast .wav file:
./main -m wispher-v3-8bit-ggml.bin -t 4 -f podcast69episode.wav -of podcast69transcript -otxt -nt -np
Other quants included, the k quants are experimental.
q5_1 and q8 tested and work well.
- License
- apache-2.0
- Created
- Mar 13, 2024
- Updated
- Mar 13, 2024