Downloads · 30 days
243
6% of all-time downloads
Mungert/kani-tts-400m-en-GGUF
kani-tts-400m-en-GGUF is a text-to-speech model from Mungert. Use it when you need text read aloud. It is set up for transformers. The card lists the license as apache-2.0.
This model was generated using llama.cpp at commit c5023daf6.
Downloads · 30 days
243
6% of all-time downloads
All-time downloads
4K
Public
Repo size
5.3 GB
Likes
1
Public
Click a slice to open those files.
.gguf5.3 GB · 100%
From the Hugging Face model README
This model was generated using llama.cpp at commit c5023daf6.
A high-speed, high-fidelity Text-to-Speech model optimized for real-time conversational AI applications.
KaniTTS uses a two-stage pipeline combining a large language model with an efficient audio codec for exceptional speed and audio quality. The architecture generates compressed token representations through a backbone LLM, then rapidly synthesizes waveforms via neural audio codec, achieving extremely low latency.
Key Specifications:
On NovitaAI RTX 5090 using vLLM:
| GPU Model | VRAM | Cost ($/hr) | RTF |
|---|---|---|---|
| RTX 5090 | 32GB | $0.423 | 0.190 |
| RTX 4080 | 16GB | $0.220 | 0.200 |
| RTX 5060 Ti | 16GB | $0.138 | 0.529 |
| RTX 4060 Ti | 16GB | $0.122 | 0.537 |
| RTX 3060 | 12GB | $0.093 | 0.600 |
Lower RTF is better (< 1.0 means faster than real-time). Benchmarks conducted on Vast AI.
It’s a lightweight so you can install, load a model, and speak in minutes. Designed for quick starts and simple workflows—no heavy setup, just pip install and run. More detailes...
pip install kani-tts
pip install -U "transformers==4.57.1" # for LFM2 !!!
from kani_tts import KaniTTS
model = KaniTTS('nineninesix/kani-tts-400m-en')
# Generate audio from text
audio, text = model("Hello, world!")
# Save to file (requires soundfile)
model.save_audio(audio, "output.wav")
This model support multiple speakers. You can check if your model supports speakers and select a specific voice:
from kani_tts import KaniTTS
model = KaniTTS('nineninesix/kani-tts-400m-en')
# Check if model supports multiple speakers
print(f"Model type: {model.status}") # 'singlspeaker' or 'multispeaker'
# Display available speakers (pretty formatted)
model.show_speakers()
# Or access the speaker list directly
print(model.speaker_list) # ['andrew', 'katie']
# Generate audio with a specific speaker
audio, text = model("Hello, world!", speaker_id="andrew")
from kani_tts import KaniTTS
model = KaniTTS(
'your-model-name',
temperature=0.7, # Control randomness (default: 1.0)
top_p=0.9, # Nucleus sampling (default: 0.95)
max_new_tokens=2000, # Max audio length (default: 1200)
repetition_penalty=1.2, # Prevent repetition (default: 1.1)
suppress_logs=True, # Suppress library logs (default: True)
show_info=True, # Show model info on init (default: True)
)
audio, text = model("Your text here")
You can listen to generated audio directly in Jupyter notebooks or IPython:
from kani_tts import KaniTTS
from IPython.display import Audio as aplay
model = KaniTTS('your-model-name')
audio, text = model("Hello, world!")
# Play audio in notebook
aplay(audio, rate=model.sample_rate)
andrewkatie| Text | Audio |
|---|---|
| Holy fu- Oh my God! Don't you understand how dangerous it is? | <audio controls src="https://cdn-uploads.huggingface.co/production/uploads/64fab67bd268b2f1ad8a826b/yYang33YNp7dg1HSCPxvc.wav"></audio> |
| Colleges of Oxford, Cambridge, Durham and the University of the Highlands and Islands UHI are 'listed bodies', as bodies that appear to the Secretary of State to be constituent colleges, schools, halls or other institutions of a university. | <audio controls src="https://cdn-uploads.huggingface.co/production/uploads/64fab67bd268b2f1ad8a826b/KeOTsGMVdaqZuaRoYoqMw.wav"></audio> |
| A joyful flock of sparrows chirped merrily in the old oak tree outside my window this morning. | <audio controls src="https://cdn-uploads.huggingface.co/production/uploads/64fab67bd268b2f1ad8a826b/6Ws-ceO3VYdYf2J9oj_O1.wav"></audio> |
| Darlin', I still ain't feelin' so well. I'm goin' to bed. | <audio controls src="https://cdn-uploads.huggingface.co/production/uploads/64fab67bd268b2f1ad8a826b/p9tyug2OOsegyxjSY672b.wav"></audio> |
Models:
Examples:
Links:
Built on top of LiquidAI LFM2 350M as the backbone and Nvidia NanoCodec for audio processing.
Prohibited activities include:
Have a question, feedback, or need support? Please fill out our contact form and we'll get back to you as soon as possible.
@inproceedings{emilialarge,
author={He, Haorui and Shang, Zengqiang and Wang, Chaoren and Li, Xuyuan and Gu, Yicheng and Hua, Hua and Liu, Liwei and Yang, Chen and Li, Jiaqi and Shi, Peiyang and Wang, Yuancheng and Chen, Kai and Zhang, Pengyuan and Wu, Zhizheng},
title={Emilia: A Large-Scale, Extensive, Multilingual, and Diverse Dataset for Speech Generation},
booktitle={arXiv:2501.15907},
year={2025}
}
@article{emonet_voice_2025,
author={Schuhmann, Christoph and Kaczmarczyk, Robert and Rabby, Gollam and Friedrich, Felix and Kraus, Maurice and Nadi, Kourosh and Nguyen, Huu and Kersting, Kristian and Auer, Sören},
title={EmoNet-Voice: A Fine-Grained, Expert-Verified Benchmark for Speech Emotion Detection},
journal={arXiv preprint arXiv:2506.09827},
year={2025}
}
<!--End Original Model Card-->
Help me test my AI-Powered Quantum Network Monitor Assistant with quantum-ready security checks:
The full Open Source Code for the Quantum Network Monitor Service available at my github repos ( repos with NetworkMonitor in the name) : Source Code Quantum Network Monitor. You will also find the code I use to quantize the models if you want to do it yourself GGUFModelBuilder
💬 How to test:
Choose an AI assistant type:
TurboLLM (GPT-4.1-mini)HugLLM (Hugginface Open-source models)TestLLM (Experimental CPU-only)I’m pushing the limits of small open-source models for AI network monitoring, specifically:
🟡 TestLLM – Current experimental model (llama.cpp on 2 CPU threads on huggingface docker space):
🟢 TurboLLM – Uses gpt-4.1-mini :
🔵 HugLLM – Latest Open-source models:
"Give me info on my websites SSL certificate""Check if my server is using quantum safe encyption for communication""Run a comprehensive security audit on my server"I fund the servers used to create these model files, run the Quantum Network Monitor service, and pay for inference from Novita and OpenAI—all out of my own pocket. All the code behind the model creation and the Quantum Network Monitor project is open source. Feel free to use whatever you find helpful.
If you appreciate the work, please consider buying me a coffee ☕. Your support helps cover service costs and allows me to raise token limits for everyone.
I'm also open to job opportunities or sponsorship.
Thank you! 😊