#164 · Primary category: Speech & Audio
whisper.unity
Running speech to text model (whisper.cpp) in Unity3d on your local machine.
Project last updated:04/17/25
GitHub Stars
750
Forks
183
Contributors
6
License
MIT
Why we included this project
Unity developers who want speech recognition without sending audio to a cloud service will find this a good fit. It's a C# binding layer over whisper.cpp, so OpenAI's Whisper models run inside a Unity project, with sample scenes and microphone input already set up. That gives you multilingual speech-to-text and language translation (German speech to English text, for example) in games, VR/AR apps, or kiosks, all offline. It runs on Windows, macOS, Linux, iOS, Android, and visionOS, with optional Vulkan or Metal acceleration. The repo ships with the tiny model so you can test immediately, and you can drop in larger weights when accuracy matters more than speed.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
whisper.cpp
Port of OpenAI's Whisper model in C/C++
Real-Time-Voice-Cloning
Clone a voice in 5 seconds to generate arbitrary speech in real-time
VibeVoice
Open-Source Frontier Voice AI
voicebox
The open-source AI voice studio. Clone, dictate, create.
TTS
🐸💬 - a deep learning toolkit for Text-to-Speech, battle-tested in research and production