#173 · Primary category: Speech & Audio
VAD
Voice activity detection (VAD) toolkit including DNN, bDNN, LSTM and ACAM based VAD. We also provide our directly recorded dataset.
Project last updated:06/09/21
GitHub Stars
869
Forks
232
Contributors
1
License
GPL-3.0
Why we included this project
Voice activity detection, figuring out where speech actually starts and stops in an audio stream, is a small piece that can quietly make or break a speech pipeline. This repository from KAIST bundles four VAD classifiers: a plain DNN, a boosted variant, an LSTM recurrent network, and an adaptive context attention model, all fed with multi-resolution cochleagram features rather than ordinary spectrograms. It also ships a manually annotated dataset recorded on a phone across four noisy environments, useful both for benchmarking and for seeing what realistic training data looks like. The honest caveats are that feature extraction depends on MATLAB and runs slowly, and the training code targets TensorFlow 1.x, so treat this as a reference for understanding the full workflow rather than something to drop straight into production. Students walking through how these models are trained end to end, or a team prototyping a segmenter before moving to a maintained library, will get the most out of it.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
whisper.cpp
Port of OpenAI's Whisper model in C/C++
Real-Time-Voice-Cloning
Clone a voice in 5 seconds to generate arbitrary speech in real-time
VibeVoice
Open-Source Frontier Voice AI
voicebox
The open-source AI voice studio. Clone, dictate, create.
TTS
🐸💬 - a deep learning toolkit for Text-to-Speech, battle-tested in research and production