#178 · Primary category: AI Agents & Automation

speech-to-speech

ai assistant language-model machine-learning python speech speech-synthesis speech-to-text speech-translation

Build voice agents with open-source models

Project last updated:08/28/26

GitHub Stars

12.9K

Forks

1.6K

Contributors

45

License

Apache-2.0

Why we included this project

If you want a voice assistant that runs without phoning home, this project hands you a working conversation server instead of a pile of speech models to integrate yourself. It chains voice activity detection, speech-to-text, an LLM, and text-to-speech through queues, and every stage is swappable from the command line, so you can start with hosted inference and later move the language model onto a local vLLM or llama.cpp box while leaving the rest alone. Since it exposes an OpenAI Realtime-compatible WebSocket API, an app that already talks to that endpoint can be pointed at this server almost unchanged. The fact that it powers real consumer robots suggests the pipeline holds up under genuine turn-taking and latency pressure, not just scripted demos.

Articles for this project

No articles for this project yet.

To suggest a topic or contribute an article, contact us.

Related projects in this category