Downloads · 30 days
0
cpumaxx/SoVITS-anime-female-brickwall-tts
SoVITS-anime-female-brickwall-tts is a text-to-speech model from cpumaxx. Use it when you need text read aloud. The card lists the license as mit.
Following this guide with exceptions - https://rentry.org/GPT-SoVITS-guide
Downloads · 30 days
0
Access
Public
Updated Nov 29, 2024
Repo size
240 MB
Likes
1
Public
Click a slice to open those files.
.ckpt155 MB · 65%
From the Hugging Face model README
Following this guide with exceptions - https://rentry.org/GPT-SoVITS-guide
I used the latest git pull from - https://github.com/RVC-Boss/GPT-SoVITS/
I created a Firefox screen-reader plugin to work with SoVITS - https://addons.mozilla.org/en-US/firefox/addon/sovits-screen-reader/ - (https://github.com/cpumaxx/sovits-ff-plugin)
I needed to put:
export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/path/to/cudann/lib/
in my shell.
put the pth file in your SoVITS_weights_v2 folder and the ckpt in GPT_weights_v2
make both Language for Reference audio and Inference text language "Japanese", set slicing to "Slice by every punct".
the underlying model was trained on audio that was brickwall dynamic range compressed, like that commonly found in visual novels or video games.
you should be able to give it a CLEAN AND NOISE/MUSIC/STATIC free FEMALE Japanese voice clip from 3-10 seconds, give it a 100% ACCURATE transcription and get ok results out the other side.
I have found that results can be improved applying post-generation noise reduction and some treble boosting EQ processing. Audacity works well enough for this, since there isn't anything in the official Gradio interface.
Feel free to keep everything else at the defaults
If you want to start the inference engine auomatically, you can use do something like
python3 /path/to/GPT_SoVITS/inference_webui.py "Auto"
If you isolate it ala https://rentry.org/IsolatedLinuxWebService and put nginx in front of it with an ssl cert, you need something like this in the location block:
proxy_pass http://127.0.0.1:9872/;
proxy_buffering off;
proxy_redirect off;
proxy_http_version 1.1;
proxy_set_header Upgrade $http_upgrade;
proxy_set_header Connection "upgrade";
proxy_set_header Host $host;
client_max_body_size 500M;
proxy_set_header X-Forwarded-Proto $scheme;
add_header 'Content-Security-Policy' 'upgrade-insecure-requests';