#98 · Primary category: Inference & Local Deploy

deepdetect

caffe deep-learning gpu image-classification image-search image-segmentation machine-learning ncnn neural-nets object-detection pytorch rest-api tensorrt tensorrt-conversion tensorrt-inference time-series tsne xgboost

Deep Learning Server and CLI for Torch and TensorRT

Project last updated:08/28/26

GitHub Stars

2.6K

Forks

546

Contributors

32

License

Other

Why we included this project

DeepDetect is a pragmatic pick if you want to serve and train models across several runtimes without juggling multiple tools. It exposes PyTorch, TensorRT, NCNN, Caffe, and XGBoost behind a single REST server and CLI, so you can handle object detection, segmentation, time series, and text workloads with one API. The newer Python wheels embed the runtime directly, and the CLI brings repeatable YAML-based profiles for tasks like YOLOX detection or SegFormer segmentation, which keeps training runs and inference reproducible. For engineers who need a long-running serving process or want model repositories kept tidy on disk, DeepDetect gives you a straightforward path from training script to production HTTP endpoint.

Articles for this project

No articles for this project yet.

To suggest a topic or contribute an article, contact us.

Related projects in this category