Downloads · 30 days
16
1% of all-time downloads
divyajot5005/Qwen3-TTS-12Hz-1.7B-Base-BNB-4bit
Qwen3-TTS-12Hz-1.7B-Base-BNB-4bit is a text-to-speech model from divyajot5005. Use it when you need text read aloud. It is set up for transformers. The card lists the license as apache-2.0.
This is a 4-bit quantized version of Qwen/Qwen3-TTS-12Hz-1.7B-Base configured for automatic bitsandbytes quantization at load time.
Downloads · 30 days
16
1% of all-time downloads
All-time downloads
1.3K
Public
Parameters
1.9B
4.5 GB on disk
Likes
2
Public
Click a slice to open those files.
.safetensors4.5 GB · 100%
From the Hugging Face model README
This is a 4-bit quantized version of Qwen/Qwen3-TTS-12Hz-1.7B-Base configured for automatic bitsandbytes quantization at load time.
This model contains the original weights plus a quantization_config in config.json. When you load the model, it will automatically be quantized to 4-bit using bitsandbytes NF4 quantization.
Memory savings: ~75% reduction compared to full precision.
pip install qwen-tts bitsandbytes>=0.42.0 accelerate
from qwen_tts import Qwen3TTSModel
import torch
# Model will be automatically quantized when loaded
model = Qwen3TTSModel.from_pretrained(
"YOUR_USERNAME/Qwen3-TTS-12Hz-1.7B-Base-BNB-4bit",
device_map="auto",
)
# Voice cloning example
import soundfile as sf
wavs, sr = model.generate_voice_clone(
text="Hello, this is a test of the quantized model.",
language="English",
ref_audio="path/to/reference.wav",
ref_text="Transcript of your reference audio.",
)
sf.write("output.wav", wavs[0], sr)
| Setting | Value |
|---|---|
| Method | bitsandbytes |
| Bits | 4 |
| Quant Type | NF4 (Normalized Float 4) |
| Compute Dtype | bfloat16 |
| Double Quant | Yes |
Based on Qwen/Qwen3-TTS-12Hz-1.7B-Base. Please refer to the original model card for full documentation.
Apache 2.0 (same as original model)