Downloads · 30 days
13
4% of all-time downloads
DINO-HuVITS
SazerLife/DINO-HuVITS
DINO-HuVITS is a audio-to-audio model from SazerLife. Use it for the audio-to-audio task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as mit.
Разработка данной модели вдохновлена статьёй DINO-VITS. В основе лежит архитектура VITS, в которой оригинальный PosteriorEncoder был заменён на модель HuBERT Base, а обучение SpeakerEncoder происходило с помощью функц…
All-time downloads
306
Public
Parameters
128M
514 MB on disk
Likes
4
Public
Repo makeup
Click a slice to open those files.
.safetensors514 MB · 100%
At a glance
- Task
- Audio-to-Audio
- Library
- transformers
- License
- mit
- Model type
- DINO-HuVITS
- Access
- Public
- Created
- Jun 10, 2024
- Updated
- Oct 22, 2024
- SHA
- c828e595
Model card
From the Hugging Face model README
DINO-HuVITS
Info
Разработка данной модели вдохновлена статьёй DINO-VITS.
В основе лежит архитектура VITS, в которой оригинальный PosteriorEncoder был заменён на модель HuBERT Base, а обучение SpeakerEncoder происходило с помощью функции потерь DINO.
Quick start
import librosa
import torch
from dino_huvits import DinoHuVits
model = DinoHuVits.from_pretrained("SazerLife/DINO-HuVITS")
model = model.eval()
content, _ = librosa.load("<content-path>", sr=16000)
reference, _ = librosa.load("<reference-paht>", sr=16000)
content = torch.from_numpy(content).unsqueeze(0)
lengths = torch.tensor([content.shape[1]], dtype=torch.long)
reference = torch.from_numpy(reference).unsqueeze(0)
with torch.no_grad():
output, _ = model(content, lengths, reference)
Datasets
- Task
- Audio-to-Audio
- Library
- transformers
- Type
- DINO-HuVITS
- License
- mit
- Languages
- ru
- Created
- Jun 10, 2024
- Updated
- Oct 22, 2024