VibeVoice-7B-GGUF

VibeVoice-7B — GGUF

GGUF conversions of microsoft/VibeVoice-7B for use with the crispasr CLI from CrispStrobe/CrispASR.

VibeVoice-7B is the largest model in Microsoft's VibeVoice family — a 9.3B-parameter speech-LLM (Qwen2.5-7B decoder + dual σ-VAE encoders) with state-of-the-art ASR quality across 50+ languages.

• 60-minute long-form audio in a single forward pass
• Built-in speaker diarization — Speaker IDs per segment
• Word-level timestamps
• Hotword / context injection via --context
• 50+ languages with automatic language detection
• MIT licence

Update (April 2026): Now includes both ASR (encoder + LM) and TTS (σ-VAE decoder + prediction head). TTS requires ≥Q4_K for good quality — Q3_K is too aggressive for the decoder. For faster/smaller TTS, use VibeVoice-Realtime-0.5B or VibeVoice-1.5B.

Files

The quantized files keep the diffusion prediction head, connectors and EOS classifier at full precision (only the LM backbone is quantized). The head runs under classifier-free guidance, so quantizing it could push the first frames onto a wrong trajectory that decodes as a brief non-speech "music"/hum onset before the voice; keeping it full-precision avoids that at a small size cost.

Quick Start

# 1. Build CrispASR
git clone https://github.com/CrispStrobe/CrispASR
cd CrispASR
cmake -B build -DCMAKE_BUILD_TYPE=Release -DGGML_METAL=ON   # macOS
cmake --build build -j$(nproc)

# 2. Download the quantised GGUF
huggingface-cli download cstr/VibeVoice-7B-GGUF \
    vibevoice-7b-q4_k.gguf --local-dir .

# 3. Transcribe
./build/bin/crispasr --model vibevoice-7b-q4_k.gguf \
    --file audio.wav --backend vibevoice

Audio is automatically resampled from 16 kHz to 24 kHz by the backend.

Architecture

Hardware Requirements

GPU acceleration (Metal/CUDA) is strongly recommended for the 7B model. CPU-only inference is very slow (~10× slower than realtime).

Conversion

Converted from microsoft/VibeVoice-7B safetensors using the streaming memory-mapped converter:

python3 models/convert-vibevoice-stream-gguf.py \
    --input microsoft/VibeVoice-7B \
    --output vibevoice-7b-f16.gguf

# Quantize
./build/bin/crispasr-quantize vibevoice-7b-f16.gguf vibevoice-7b-q4_k.gguf q4_k

The streaming converter (convert-vibevoice-stream-gguf.py) uses memory-mapped tensor access to avoid loading the full 19 GB model into RAM.

Provenance and EU AI Act Art. 53 note

• Upstream model: microsoft/VibeVoice-7B.
• Upstream licence: mit. This repository redistributes under the same terms; it grants no rights the upstream licence does not.
• What was done here: format conversion and/or quantisation only (GGUF/GGML). No training, no fine-tuning, no merging, no distillation, no change to architecture, vocabulary or capability. Only the numeric representation of the upstream weights differs.
• Training data: documented — where it is documented at all — by the upstream provider; see the upstream model card. No training data was used, added or selected by this repository.
• Provider status: under Regulation (EU) 2024/1689 the upstream authors remain the provider of this model. Converting the serialisation format does not make this repository the provider of a new general-purpose AI model, and no such claim is made. Questions about training content, copyright policy or model capability belong upstream.