#108 · Primary category: Speech & Audio
Whisper-Finetune
Fine-tune the Whisper speech recognition model to support training without timestamp data, training with timestamp data, and training without speech data. Accelerate inference and support Web deployment, Windows desktop deployment, and Android deployment
Project last updated:05/08/26
GitHub Stars
1.2K
Forks
223
Contributors
4
License
Apache-2.0
Why we included this project
Whisper-Finetune is the kind of toolkit you reach for when OpenAI's stock Whisper checkpoints don't quite fit your domain. It handles the whole pipeline in one place: preparing training data such as AIShell or WenetSpeech, LoRA fine-tuning on models from tiny up to large-v3-turbo, merging the adapters back in, evaluating character error rate, and converting the result to CTranslate2 or GGML for faster inference. The data handling is its real strength, since you can train with timestamps, without them, or even with transcripts and no audio at all, which matters when your dataset is messy or you only have text to work from. It also goes beyond training, shipping a server API, a Windows desktop app, and an Android demo so a tuned model can actually reach users instead of staying in a notebook.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
whisper.cpp
Port of OpenAI's Whisper model in C/C++
Real-Time-Voice-Cloning
Clone a voice in 5 seconds to generate arbitrary speech in real-time
VibeVoice
Open-Source Frontier Voice AI
voicebox
The open-source AI voice studio. Clone, dictate, create.
TTS
🐸💬 - a deep learning toolkit for Text-to-Speech, battle-tested in research and production