#108 · Primary category: Speech & Audio

Whisper-Finetune

android asr chinese ctranslate2 huggingface lora pytorch speech-recognition transformers web whisper

Fine-tune the Whisper speech recognition model to support training without timestamp data, training with timestamp data, and training without speech data. Accelerate inference and support Web deployment, Windows desktop deployment, and Android deployment

Project last updated:05/08/26

GitHub Stars

1.2K

Forks

223

Contributors

4

License

Apache-2.0

Why we included this project

Whisper-Finetune is the kind of toolkit you reach for when OpenAI's stock Whisper checkpoints don't quite fit your domain. It handles the whole pipeline in one place: preparing training data such as AIShell or WenetSpeech, LoRA fine-tuning on models from tiny up to large-v3-turbo, merging the adapters back in, evaluating character error rate, and converting the result to CTranslate2 or GGML for faster inference. The data handling is its real strength, since you can train with timestamps, without them, or even with transcripts and no audio at all, which matters when your dataset is messy or you only have text to work from. It also goes beyond training, shipping a server API, a Windows desktop app, and an Android demo so a tuned model can actually reach users instead of staying in a notebook.

Articles for this project

No articles for this project yet.

To suggest a topic or contribute an article, contact us.

Related projects in this category