VieNeu-Codec

VieNeu-Codec: The Heart of VieNeu-TTS v2

VieNeu-Codec is the high-performance audio engine built specifically for the upcoming VieNeu-TTS v2. It is a neural audio codec trained on over 20,000 hours of diverse Vietnamese and English speech data, ensuring state-of-the-art robustness, natural prosody, and crystal-clear audio reconstruction.

This repository provides the optimized ONNX versions of the VieNeu-Codec for production use.

🚀 Key Features

• 24kHz High-Fidelity: Crystal clear audio reconstruction optimized for the Vietnamese language.
• Zero-Shot Voice Cloning: Clone any voice with just 5 seconds of reference audio.
• Optimized for VieNeu-TTS v2: Seamlessly integrates with the next-generation LLM backbone of VieNeu-TTS.
• Two Deployment Modes: Includes both FP32 (High Quality) and INT8 (High Speed) decoders.

📦 Model Components

• vieneu_decoder.onnx: (FP32) High-fidelity audio decoder for maximum quality.
• vieneu_decoder_int8.onnx: (INT8) Quantized decoder for fast CPU inference.

🛠️ Usage

Synthesize Speech

Combine the speaker embedding with content tokens from your LLM (VieNeu-TTS v2):

sess_dec = ort.InferenceSession("vieneu_decoder.onnx")
audio = sess_dec.run(None, {
    "content_ids": ids,
    "voice": embedding
})[0]

📄 License & Attribution

Author: Pham Nguyen Ngoc Bao
Project: VieNeu-Codec (for VieNeu-TTS v2)
Version: 2.0