#215 · Primary category: Speech & Audio
vits-finetuning
Fine-Tuning your VITS model using a pre-trained model
Project last updated:05/02/23
GitHub Stars
543
Forks
82
Contributors
1
License
MIT
Why we included this project
Building a custom text-to-speech voice usually means training a model from scratch, which is expensive. This project skips that by fine-tuning VITS from a pre-trained checkpoint, and it documents the whole process: preparing a Japanese audio-text dataset, resampling clips to the required format, preprocessing, and multi-speaker training. The README is honest about data needs, noting that roughly fifty audio-text pairs can already give decent results, which makes it practical for hobbyists and small teams chasing a character or personal voice. A Google Colab notebook covers both training and inference, so you don't need your own GPU. The main limitation is that only Japanese datasets are supported, so it only.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
whisper.cpp
Port of OpenAI's Whisper model in C/C++
Real-Time-Voice-Cloning
Clone a voice in 5 seconds to generate arbitrary speech in real-time
VibeVoice
Open-Source Frontier Voice AI
voicebox
The open-source AI voice studio. Clone, dictate, create.
TTS
🐸💬 - a deep learning toolkit for Text-to-Speech, battle-tested in research and production