#3 · Primary category: Speech & Audio
VibeVoice
Open-Source Frontier Voice AI
Project last updated:07/24/26
GitHub Stars
53.3K
Forks
6.0K
Contributors
22
License
MIT
Why we included this project
VibeVoice pairs a long-form ASR model with a multi-speaker TTS line, so one repo covers both directions of the speech pipeline. The ASR side transcribes up to 60 minutes of audio in a single pass, returns speaker labels and timestamps, and accepts custom hotwords for domain terms, which makes it useful for meeting transcription or call analytics rather than just demos. It runs natively in over 50 languages, and the finetuning code plus a quantized CPU inference engine (no GPU required) cover the path from training to edge deployment. The TTS side handles long-form, multi-speaker synthesis with streaming input. Models are on Hugging Face, with Colab demos and vLLM integration, so teams can go from download to a working pipeline quickly.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
whisper.cpp
Port of OpenAI's Whisper model in C/C++
Real-Time-Voice-Cloning
Clone a voice in 5 seconds to generate arbitrary speech in real-time
voicebox
The open-source AI voice studio. Clone, dictate, create.
TTS
🐸💬 - a deep learning toolkit for Text-to-Speech, battle-tested in research and production
ChatTTS
A generative speech model for daily dialogue.