#43 · Primary category: Speech & Audio
whisper-diarization
Automatic Speech Recognition with Speaker Diarization based on OpenAI Whisper
Project last updated:08/15/26
GitHub Stars
5.6K
Forks
503
Contributors
13
License
BSD-2-Clause
Why we included this project
A transcript without speaker labels is only half useful when several people are in the recording. This pipeline connects OpenAI Whisper's transcription to a voice-activity detector and a speaker-embedding model, so each sentence in the output is tagged with the voice that said it. It strips out the vocals first to give the speaker embeddings cleaner audio, then returns a labeled, timestamped transcript instead of an undifferentiated block of text. Teams building meeting-note tools or searching through call recordings can treat it as a ready-made building block, and the included Colab notebook makes it easy to try against your own files before going further.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
whisper.cpp
Port of OpenAI's Whisper model in C/C++
Real-Time-Voice-Cloning
Clone a voice in 5 seconds to generate arbitrary speech in real-time
VibeVoice
Open-Source Frontier Voice AI
voicebox
The open-source AI voice studio. Clone, dictate, create.
TTS
🐸💬 - a deep learning toolkit for Text-to-Speech, battle-tested in research and production