Downloads · 30 days
9
3% of all-time downloads
mini-omni-safetensors
leafspark/mini-omni-safetensors
mini-omni-safetensors is a machine learning model from leafspark. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
<p align="center"<strong style="font-size: 18px;" Mini-Omni: Language Models Can Hear, Talk While Thinking in Streaming </strong </p
All-time downloads
286
Public
Parameters
694M
2.8 GB on disk
Likes
5
Public
Repo makeup
Click a slice to open those files.
.safetensors2.8 GB · 100%
At a glance
- License
- mit
- Access
- Public
- Created
- Sep 3, 2024
- Updated
- Sep 3, 2024
- SHA
- 008b40e7
Base models
Model card
From the Hugging Face model README
<p align="center"><strong style="font-size: 18px;">
Mini-Omni: Language Models Can Hear, Talk While Thinking in Streaming
</strong>
</p>
<p align="center">
🤗 <a href="">Hugging Face</a> | 📖 <a href="https://github.com/gpt-omni/mini-omni">Github</a>
| 📑 <a href="https://arxiv.org/abs/2408.16725">Technical report</a>
</p>
This is a safetensors conversion of gpt-omni/mini-omni.
Mini-Omni is an open-source multimodel large language model that can hear, talk while thinking. Featuring real-time end-to-end speech input and streaming audio output conversational capabilities.
<p align="center"> <img src="frameworkv3.jpg" width="100%"/> </p>Features
✅ Real-time speech-to-speech conversational capabilities. No extra ASR or TTS models required.
✅ Talking while thinking, with the ability to generate text and audio at the same time.
✅ Streaming audio outupt capabilities.
✅ With "Audio-to-Text" and "Audio-to-Audio" batch inference to further boost the performance.
NOTE: please refer to https://github.com/gpt-omni/mini-omni for more details.
- License
- mit
- Languages
- en
- Created
- Sep 3, 2024
- Updated
- Sep 3, 2024