#143 · Primary category: Inference & Local Deploy
TensorRT-YOLO
🚀 Easier & Faster YOLO Deployment Toolkit for NVIDIA 🛠️
Project last updated:03/22/26
GitHub Stars
1.9K
Forks
194
Contributors
1
License
GPL-3.0
Why we included this project
Deploying a YOLO model on NVIDIA hardware means more than exporting weights. You still have to convert to TensorRT engines, speed up preprocessing, and hook the results into an application. This toolkit bundles that whole pipeline into C++ and Python APIs, with CUDA kernels and CUDA Graph execution doing the speed work and TensorRT plugins handling the postprocessing. One code path serves detection, instance segmentation, pose estimation, classification, and rotated bounding boxes, so a team can standardize on a single deployment library instead of writing per-task glue code. Embedded setups get attention too, with x86 and ARM builds, zero-copy memory handling for Jetson-style devices, and a single-header C++ option that keeps CUDA and TensorRT link dependencies out of larger applications. Runnable examples for each task make it a handy reference when you are wiring up your own inference service or comparing engine settings.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
ollama
Get up and running with Kimi-K2.6, GLM-5.2, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
llama.cpp
LLM inference in C/C++
vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
gpt4all
GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.
LocalAI
LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.