#86 · Primary category： Inference & Local Deploy
harbor
Stop configuring your AI stack. Start using it. One command brings a complete pre-wired LLM stack with hundreds of services to explore.
Project last updated：08/29/26
GitHub Stars
3.2K
Forks
224
Contributors
22
License
Apache-2.0
Why we included this project
Harbor takes the setup work out of running a self-hosted LLM stack. One `harbor up` brings up a full environment, wiring backends like Ollama, llama.cpp, and vLLM to a frontend such as Open WebUI, with SearXNG for web search, Speaches for voice, and ComfyUI for image generation connected and ready. You pick the services you want from the collection, and Harbor handles the cross-service wiring so they work together without hand-written Docker Compose files. That makes it a good fit for developers and homelab users who want a private, offline AI setup, and for teams that want to try several backends side by side before committing to one.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
ollama
Get up and running with Kimi-K2.6, GLM-5.2, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
llama.cpp
LLM inference in C/C++
vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
gpt4all
GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.
LocalAI
LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.