moss-voicegen-gguf

MOSS-VoiceGenerator BF16 GGUF for OpenMOSS

GGUF weights for OpenMOSS-Team/MOSS-VoiceGenerator, converted for the OpenMOSS C++/GGML runtime.

Precision correction

Both files in this revision are FP16-free. The VoiceGenerator checkpoint is trained and loaded as BF16 by the official CUDA reference. FP16 is unsafe for this model because its attention-sink activations can exceed FP16's finite range.

The audio sidecar has also been rebuilt without the converter's former BF16/FP32 to FP16 intermediate cast. Ordinary learned weights are BF16. Normalization tensors and the audio tokenizer's float32 residual-vector-quantizer tensors remain FP32.

Required files

Both files must remain beside each other. The sidecar identifies the model as moss_tts_delay, with 16 RVQ codebooks and 24 kHz mono output.

Source revisions

• VoiceGenerator: OpenMOSS-Team/MOSS-VoiceGenerator@97521ec2b6f3ec5026ac1f5751f8fc302d82c2d4
• Audio tokenizer: OpenMOSS-Team/MOSS-Audio-Tokenizer@3cd226ba2947efa357ef453bcad111b6eafba782
• Converter/runtime base: pwilkin/openmoss@d1f2976a89fd51bf949d28320af401e523b78c67, plus BF16-preserving conversion and BF16/FP32 codec-sidecar loading

Runtime requirement

Use an OpenMOSS build with BF16/FP32 codec-sidecar loading support. Older builds that require moss.codec.quantizer.* tensors to be FP16 cannot decode this corrected sidecar and fail with an expected f16 error. Converting those tensors back to FP16 is not a valid workaround because the upstream audio tokenizer keeps its residual-vector-quantizer math in FP32.

Validation

• Tensor audit: zero FP16 tensors in both files.
• CPU: model load, natural end-of-speech, 62-frame codec decode, and a 4.96-second WAV.
• Vulkan: full model/sidecar load, natural end-of-speech, 52-frame codec decode, and a 4.16-second WAV.
• CPU Whisper check of the pilot recovered the requested pangram through its final word; waveform QA found no clipping or late crop transient.

OpenMOSS usage

moss-tts-cli \
  --model moss-voicegen.gguf \
  --template voicegen \
  --text "The quick brown fox jumps over the lazy dog." \
  --instruction "Clear, neutral voice with an even tempo and precise articulation." \
  --output voice.wav

Use the dedicated VoiceGenerator template. For upstream-equivalent behavior, do not add a language field, forced duration, or hard audio-frame cap unless the application requires one.

License

The source model and these converted weights are provided under Apache 2.0.