#64 · Primary category: Inference & Local Deploy

ODS

ai-agents amd comfyui docker llama-cpp llm local-ai n8n nvidia open-webui rag self-hosted speech-to-text strix-halo text-to-speech workflow-automation

Turn your PC, Mac, or Linux box into an AI server. LLM inference, chat UI, voice, agents, workflows, RAG, and image generation.

Project last updated:08/30/26

GitHub Stars

4.9K

Forks

741

Contributors

65

License

Apache-2.0

Why we included this project

ODS is for people who want a private AI server on their own hardware but would rather not spend a weekend gluing Ollama, a chat frontend, an automation tool, an image generator, and a document retrieval stack together by hand. It is a one-command installer and runtime that pulls all of that into a single compose-based stack, so you get local inference, a browser-based chat UI, voice, agents, workflows, RAG, and image generation without managing each service separately. A dashboard on top handles models, services, GPU status, and extensions from one place. Everything runs locally by default, which means prompts and data stay on your machine; cloud and hybrid API modes are there if you want them. Homelab users and small teams that want a reproducible AI environment on hardware they control get a working setup in one shot, instead of the usual multi-tool wiring job.

Articles for this project

No articles for this project yet.

To suggest a topic or contribute an article, contact us.

Related projects in this category