#10 · Primary category: Speech & Audio
whisperX
WhisperX: Automatic Speech Recognition with Word-level Timestamps (& Diarization)
Project last updated:07/13/26
GitHub Stars
23.8K
Forks
2.4K
Contributors
118
License
BSD-2-Clause
Why we included this project
Whisper gives you a transcript, but not the word-level timing that subtitles and search tools need. WhisperX fixes that by adding forced phoneme alignment and voice-activity detection on top of OpenAI's ASR model, so each word gets a timestamp that actually lines up with the audio, and it batches inference to run fast. That per-word precision matters for subtitle generation, meeting notes, and media search, where you want to jump straight to the moment a phrase was spoken. It also layers in speaker diarization via pyannote, so multi-speaker recordings come out labeled by who said what. A CLI and Python API keep it easy to slot into existing transcription pipelines, and the alignment models cover a useful range of languages out of the box.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
whisper.cpp
Port of OpenAI's Whisper model in C/C++
Real-Time-Voice-Cloning
Clone a voice in 5 seconds to generate arbitrary speech in real-time
VibeVoice
Open-Source Frontier Voice AI
voicebox
The open-source AI voice studio. Clone, dictate, create.
TTS
🐸💬 - a deep learning toolkit for Text-to-Speech, battle-tested in research and production