#163 · Primary category： Inference & Local Deploy
CodeProject.AI-Server
CodeProject.AI Server is a self contained service that software developers can include in, and distribute with, their applications in order to augment their apps with the power of AI.
Project last updated：07/14/25
GitHub Stars
977
Forks
231
Contributors
12
License
Other
Why we included this project
Instead of wiring each feature to a cloud endpoint, developers install CodeProject.AI on the user's machine and talk to it through a REST API over localhost. Object detection, face recognition, scene analysis, text summarization, and even generative tasks all run on-device, so nothing leaves the box. That fits desktop apps, kiosks, and IoT setups where offline reliability and privacy outweigh hosted APIs, and it keeps model serving uniform across Windows, macOS, Linux, and Raspberry Pi. You can run it as a standalone service or a Docker container, which gives a small team a working AI layer without maintaining a separate ML platform, and the bundled pre-trained modules are a reasonable starting point before you swap in custom models.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
ollama
Get up and running with Kimi-K2.6, GLM-5.2, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
llama.cpp
LLM inference in C/C++
vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
gpt4all
GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.
LocalAI
LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.