#98 · Primary category: Inference & Local Deploy
deepdetect
Deep Learning Server and CLI for Torch and TensorRT
Project last updated:08/28/26
GitHub Stars
2.6K
Forks
546
Contributors
32
License
Other
Why we included this project
DeepDetect is a pragmatic pick if you want to serve and train models across several runtimes without juggling multiple tools. It exposes PyTorch, TensorRT, NCNN, Caffe, and XGBoost behind a single REST server and CLI, so you can handle object detection, segmentation, time series, and text workloads with one API. The newer Python wheels embed the runtime directly, and the CLI brings repeatable YAML-based profiles for tasks like YOLOX detection or SegFormer segmentation, which keeps training runs and inference reproducible. For engineers who need a long-running serving process or want model repositories kept tidy on disk, DeepDetect gives you a straightforward path from training script to production HTTP endpoint.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
ollama
Get up and running with Kimi-K2.6, GLM-5.2, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
llama.cpp
LLM inference in C/C++
vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
gpt4all
GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.
LocalAI
LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.