#24 · Primary category: Speech & Audio
WhisperLiveKit
Real-time, local speech-to-text with streaming ASR, speaker diarization, translation, and OpenAI/Deepgram-compatible APIs.
Project last updated:08/29/26
GitHub Stars
11.0K
Forks
1.1K
Contributors
50
License
Apache-2.0
Why we included this project
WhisperLiveKit covers the case where batch transcription won't do: when you need text as people are speaking, not after the recording ends. Standard Whisper expects a complete utterance, so feeding it live audio chunks comes back as cut-off words and missing context; this project applies simultaneous-speech research to buffer incoming audio and stream the transcript as it goes. That makes it useful for live captioning, meeting transcripts, and other realtime workloads where the text has to arrive with the speech. It also bundles real-time speaker diarization and translation into about two hundred languages, and it exposes OpenAI- and Deepgram-compatible endpoints, so existing clients can point at a local server without rewriting. Since the whole pipeline runs on your own hardware, you keep the audio in-house and avoid per-minute API fees.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
whisper.cpp
Port of OpenAI's Whisper model in C/C++
Real-Time-Voice-Cloning
Clone a voice in 5 seconds to generate arbitrary speech in real-time
VibeVoice
Open-Source Frontier Voice AI
voicebox
The open-source AI voice studio. Clone, dictate, create.
TTS
🐸💬 - a deep learning toolkit for Text-to-Speech, battle-tested in research and production