#105 · Primary category: Speech & Audio
VoiceStreamAI
Near-Realtime audio transcription using self-hosted Whisper and WebSocket in Python/JS
Project last updated:08/13/26
GitHub Stars
959
Forks
140
Contributors
3
License
MIT
Why we included this project
VoiceStreamAI is a self-hosted streaming transcription setup: a Python server takes audio over WebSocket, runs it through a voice-activity detector and a Whisper-based recognizer, and returns text in near real time instead of waiting for a whole clip to finish. The VAD and ASR components are wired together through factory and strategy patterns, so you can swap in a different detection model or transcription engine (Pyannote for detection, faster-whisper by default) and tune how audio chunks get buffered without rewriting the server. A bundled JavaScript client covers the browser side, and the Docker image simplifies GPU setup. If you want live captions, meeting notes, or voice controls running on your own hardware rather than through a commercial API, this is a solid reference implementation to build from.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
whisper.cpp
Port of OpenAI's Whisper model in C/C++
Real-Time-Voice-Cloning
Clone a voice in 5 seconds to generate arbitrary speech in real-time
VibeVoice
Open-Source Frontier Voice AI
voicebox
The open-source AI voice studio. Clone, dictate, create.
TTS
🐸💬 - a deep learning toolkit for Text-to-Speech, battle-tested in research and production