artificial-styletts2

Audionar - Phonetic variation of StyleTTS2 blend to AudioGen SoundScapes

SHIFT TTS / Audionar

Phonetic variation of SHIFT TTS blend to AudioGen soundscapes

• Analysis of emotion of SHIFT TTS
• Listen Also foreign languages

Listen Voices

<a href="https://huggingface.co/dkounadis/artificial-styletts2/discussions/1">Native English</a> / <a href="https://huggingface.co/dkounadis/artificial-styletts2/discussions/1#6783e3b00e7d90facec060c6">Non-native English: Accents</a> / <a href="https://huggingface.co/dkounadis/artificial-styletts2/discussions/1#6782c5f2a2f852eeb1027a32">Foreign languages</a>

CUDA_DEVICE_ORDER=PCI_BUS_ID HF_HOME=/data/.hf7/ CUDA_VISIBLE_DEVICES=0 python demo.py

Flask API

<details> <summary> Build virtualenv & run api.py </summary>

Above TTS Demo is a standalone script that loads TTS & AudioGen models and synthesizes a txt. We also provide a Flask api.py that allows faster inference with loading only once TTS & AudioGen

Clone

git clone https://huggingface.co/dkounadis/artificial-styletts2

Install

cd artificial-styletts2
virtualenv --python=python3.10 .env0
source .env0/bin/activate
pip install -r requirements.txt

Flask API - open a 2nd terminal

CUDA_DEVICE_ORDER=PCI_BUS_ID HF_HOME=/data/.hf7/ CUDA_VISIBLE_DEVICES=0 python api.py

Following examples need api.py to be running. Set this IP to the IP shown when starting api.py.

# git lfs pull # to download assets/ocr.jpg
python tts.py --text assets/ocr.txt --image assets/ocr.jpg --soundscape "battle hero" --voice romanian

</details>

Landscape 2 Soundscapes

The following needs api.py to be already running.

# TTS & soundscape - output .mp4 saved in ./out/
python landscape2soundscape.py

For SHIFT demo / Collaboration with SMB

• YouTube Videos

SoundScape Live Demo - Paplay

Flask API for playing sounds live

CUDA_DEVICE_ORDER=PCI_BUS_ID HF_HOME=/data/dkounadis/.hf7/ CUDA_VISIBLE_DEVICES=4 python api.py

Describe any sound via text, the tts & soundscape is played back

python live_demo.py  # type text & plays AudioGen sound & TTS

Audiobook

Create audiobook from .docx. Listen to it - YouTube male voice / female voice

#  audiobook will be saved in ./tts_audiobooks
python audiobook.py