#28 · Primary category: Speech & Audio
SenseVoice
Open-source SenseVoiceSmall model for Mandarin, Cantonese, English, Japanese, and Korean ASR, language ID, emotion recognition, and audio event detection.
Project last updated:08/27/26
GitHub Stars
9.2K
Forks
814
Contributors
25
License
MIT
Why we included this project
Building voice products for East Asian users usually means either training or paying for separate ASR models per language, then adding more components for language ID and emotion detection. SenseVoiceSmall folds transcription, spoken-language identification, emotion recognition, and audio event detection into one inference pass, so a single model returns the transcript plus context tags like laughter, applause, or coughing. It works out of the box for Mandarin, Cantonese, English, Japanese, and Korean, which covers most of the region's major markets with one piece of tooling. The non-autoregressive decoder keeps latency low enough for real-time transcription and call analytics. It is MIT-licensed, fine-tunes without much fuss, and the repo documents setup clearly and integrates with FunASR, making it easy to benchmark against Whisper before committing to a deployment.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
whisper.cpp
Port of OpenAI's Whisper model in C/C++
Real-Time-Voice-Cloning
Clone a voice in 5 seconds to generate arbitrary speech in real-time
VibeVoice
Open-Source Frontier Voice AI
voicebox
The open-source AI voice studio. Clone, dictate, create.
TTS
🐸💬 - a deep learning toolkit for Text-to-Speech, battle-tested in research and production