#106 · Primary category: Speech & Audio
vits
VITS: Conditional Variational Autoencoder with Adversarial Learning for End-to-End Text-to-Speech
Project last updated:12/06/23
GitHub Stars
7.9K
Forks
1.4K
Contributors
3
License
MIT
Why we included this project
VITS strings a whole text-to-speech pipeline into a single model, so you skip the usual chain of separate acoustic models and vocoders. It's built around a conditional variational autoencoder with normalizing flows and adversarial training, and the stochastic duration predictor is what gives the voice variety: the same sentence can come out with different pitch and rhythm instead of one fixed cadence. The authors backed the code with a published paper, pretrained models for the LJ Speech single-speaker dataset, and an interactive Colab demo, which means you can judge the audio before touching any config. Training and inference scripts cover both single-speaker and multi-speaker (VCTK) setups, so it works as a reproducible baseline for research or a base to adapt to your own data.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
whisper.cpp
Port of OpenAI's Whisper model in C/C++
Real-Time-Voice-Cloning
Clone a voice in 5 seconds to generate arbitrary speech in real-time
VibeVoice
Open-Source Frontier Voice AI
voicebox
The open-source AI voice studio. Clone, dictate, create.
TTS
🐸💬 - a deep learning toolkit for Text-to-Speech, battle-tested in research and production