Downloads · 30 days
0
klett
vibevoice-community/klett
klett is a machine learning model from vibevoice-community. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
Access
Public
Updated Jan 22, 2026
Repo size
540 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin503 MB · 64%
At a glance
- License
- mit
- Access
- Public
- Created
- Jan 22, 2026
- Updated
- Jan 22, 2026
- SHA
- 8bf9824c
Base models
Model card
From the Hugging Face model README
LoRA for VibeVoice 1.5B
Source:
Elizabeth Klett's narration of The House of the Vampire (public domain) (MP3 128k)
Dataset prep/process
Segmentation and transcription of source audio done using tts-dataset-generator (silence segmentation threshold 400ms; target samplerate 24K for VibeVoice). Some/more than some occurrences of "intra-sentence" segmentation. Audio clips normalized to -3dB. Cumulative duration 1h53m.
Training details
python -m src.finetune_vibevoice_lora --model_name_or_path microsoft/VibeVoice-1.5B --train_jsonl "path\to\metadata.jsonl" --text_column_name text --audio_column_name audio --output_dir "path\to\elizabeth_klett\lora" --per_device_train_batch_size 8 --gradient_accumulation_steps 4 --learning_rate 2.5e-5 --num_train_epochs 60 --logging_steps 10 --save_steps 200 --remove_unused_columns False --bf16 True --do_train --gradient_clipping --gradient_checkpointing False --ddpm_batch_mul 4 --diffusion_loss_weight 1.4 --train_diffusion_head True --ce_loss_weight 0.04 --voice_prompt_drop_rate 1 --lora_target_modules q_proj,k_proj,v_proj,o_proj,gate_proj,up_proj,down_proj --lr_scheduler_type cosine --warmup_ratio 0.03 --max_grad_norm 0.8 --report_to tensorboard
- License
- mit
- Languages
- en
- Created
- Jan 22, 2026
- Updated
- Jan 22, 2026